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EXECUTIVE  SUMMARY 


The  AFDC  Homemaker-Home  Health  Aide  Demonstrations,  authorized  by 
Section  966  of  the  Omnibus  Budget  Reconciliation  Act  of  1980,  were  designed  to 
test  the  feasibility  of  training  AFDC  recipients  to  provide  homemaker-home 
health  aide  services  to  functionally  impaired  persons  in  their  own  homes.   The 
Health  Care  Financing  Administration  (HCFA),  which  was  the  lead  agency  for 
implementing  the  demonstrations,  awarded  demonstration  grants  to  seven 
states:   Arkansas,  Kentucky,  New  Jersey,  New  York,  Ohio,  South  Carolina,  and 
Texas.   The  seven  demonstration  projects  began  operations  in  January  1983  and 
ran  until  June  30,  1986.   Abt  Associates  Inc.  was  the  evaluation  contractor. 

The  demonstrations  had  two  components — provision  of  homemaker-home 
health  aide  services  to  the  elderly  and  other  functionally  impaired 
individuals,  and  training  and  subsidized  employment  of  AFDC  recipients. 
Participation  in  each  component  was  voluntary.   To  allow  rigorous  evaluation, 
eligible  applicants  were  randomly  assigned  to  a  treatment  or  control  group. 
Demonstration  effects  were  measured  as  the  differences  in  outcomes  between 
treatment  and  control  group  members. 

Demonstration  Treatments 

Provision  of  Services.   The  demonstrations  provided  up  to  100  hours 
per  month  of  homemaker  and  home  health  aide  services  to  individuals  in  need  of 
long  term  care.   To  receive  the  home  care  services  authorized  under  this 
demonstration  an  individual  had  to  be  elderly  or  disabled,  and  at  risk  of 
institutionalization.   In  addition,  to  comply  with  the  legislation,  services 
could  not  be  "...reasonably  and  actually  available  or  provided..."  to  them. 
Client  applicants  were  assessed  by  health  care  and  social  service  profes- 
sionals to  determine  eligibility  to  participate  in  the  demonstration.   Clients 
assigned  to  the  service  group  could  continue  to  receive  services,  if  needed, 
as  long  as  the  demonstration  continued.   A  sliding  scale  fee  was  charged  to 
service  clients  with  incomes  greater  than  twice  the  AFDC  standard  of  need  in 
their  state. 
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Training  and  Subsidized  Employment.   The  demonstrations  provided  a 
four-  to  eight-week  period  of  homemaker-home  health  aide  training  followed  by 
up  to  a  year  of  subsidized  employment.   To  be  eligible,  an  individual  had  to 
be  currently  eligible  for  AFDC ,  must  have  received  AFDC  benefits  for  the 
previous  90  days,  and  must  not  have  been  employed  as  a  homemaker  or  home 
health  aide  during  that  period. 

Operation  of  the  Demonstration  Projects 

Client  Functions.   The  client  outreach  function  was  typically 
performed  by  demonstration  provider  agencies  or  regional  or  county  staff  of 
social  services  departments,  mainly  through  meetings  with  and  mailings  to 
relevant  agency  representatives.   The  intake  process  typically  began  with  a 
brief  preliminary  telephone  screening  interview  using  a  standard  set  of 
eligibility  criteria.   Those  clients  who  appeared  eligible  were  scheduled  for 
a  formal  structured  inperson  assessment  by  trained  assessors,  designed  to 
determine  an  applicant's  health  and  functional  status,  availability  of 
informal  support,  and  need  for  services. 

Most  of  the  agencies  providing  services  to  demonstration  clients 
were  established  service  providers.   Services  to  clients  were  mainly  homemaker 
services  and  personal  care  assistance,  though  some  clients  also  received 
health  care  assistance  or  home  management  services.   An  Independent 
Professional  Review  (IPR)  monitored  client  eligibility  and  the  appropriateness 
and  quality  of  service  delivered  to  clients.   It  included  a  record  review  on  a 
20  percent  sample  of  clients  and  an  in-home  review  of  a  5  percent  sample  of 
active  cases,  conducted  each  quarter. 

Trainee  Functions.   Mass  mailings  were  the  typical  outreach  method 
used  to  contact  AFDC  recipients  and  encourage  them  to  apply  to  the  demon- 
stration.  In  most  states,  the  mailings  were  followed  by  group  orientation 
meetings,  then  individual  interviews  with  project  staff. 

Training  included  both  classroom  and  practicum  components. 
Virtually  all  sites  used  the  Model  Curriculum  developed  by  the  National  Home 
Caring  Council  as  the  basic  framework  for  training.   The  practicum,  which 
provided  trainees  with  hands-on  experience  in  nursing  homes  and/or  in  private 
homes,  averaged  about  26  hours. 
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Following  training,  aides  were  generally  employed  by  established 
service  providers  at  wages  averaging  $3.84  per  hour.   The  typical  aide  made 
about  25  three-hour  visits  each  month,  serving  four  or  five  different  clients. 

Effects  on  Clients 

Formal  In-Home  Services.   The  demonstrations  were  expected  to  affect 
client  outcomes  by  increasing  the  total  amount  of  in-home  care  received  by 
service  clients.   It  is  important  to  remember  that  the  demonstrations  were 
implemented  in  environments  in  which  there  were  other  formal  in-home  services, 
but  for  various  reasons,  such  as  waiting  lists  or  inability  to  pay,  these 
services  were  not  available  or  provided  to  demonstration  clients  at  the  time 
they  entered  the  demonstration.   The  average  rate  of  formal  care  among  client 
controls  (including  those  receiving  no  service)  ranged  from  less  than  1  hour 
per  week  in  Arkansas  to  nearly  4  hours  per  week  in  New  York. 

•  The  demonstrations  significantly  increased  formal 
care  received  in  every  state,  by  amounts  ranging 
from  1.2  hours  per  week  in  Kentucky  to  8.3  hours  per 
week  in  South  Carolina. 

Informal  Care.  No  significant  demonstration  effects  were  found  on 
the  proportion  of  clients  who  received  uncompensated  care  from  members  of 
their  own  households.   There  were  significant  demonstration  effects  on 
informal  care  from  nonhousehold  sources,  however. 

•  Service  clients  in  five  states  were  significantly 
less  likely  than  client  controls  in  those  states  to 
receive  informal  care  from  nonhousehold  sources,  by 
amounts  ranging  from  5  to  12  percentage  points. 

•  In  six  of  the  seven  states,  the  effects  of  the 
demonstrations  in  increasing  formal  care  to  clients 
were  significantly  larger  than  the  effects  of 
decreasing  informal  care.   The  extent  to  which 
reductions  in  informal  care  offset  the  increases  in 
formal  care  ranged  from  zero  to  40  percent. 

Survival.   There  were  no  significant  demonstration  effects  on  the 
fraction  of  clients  surviving  the  followup  period  or  the  percentage  of  the 
followup  period  survived. 
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Hospital  Care.   Although  it  was  not  anticipated  that  demonstration 
services  couLd  prevent  hospital  admissions,  it  was  expected  that  they  could 
reduce  average  length  of  stay  by  enabling  service  clients  to  be  discharged 
more  quickly  to  recuperate  at  home. 

•  Over  the  one-year  followup  period  as  a  whole,  no 
significant  service-control  differences  were  found 
in  the  proportion  of  clients  hospitalized,  in  the 
mean  number  of  hospital  admissions,  or  in  the 
average  length  of  hospital  stay.   There  was, 
however,  a  statistically  significant  reduction  in 
the  time  spent  in  hospitals  in  New  Jersey  during  the 
first  six  months  of  the  followup  period. 

Nursing  Home  Care.   The  primary  goal  of  the  service  component  of  the 
demonstration  was  to  prevent  or  delay  nursing  home  admission.   This  objective 
was  not  achieved. 

•  There  were  no  significant  impacts  on  either  the  pro- 
portion of  clients  institutionalized  or  the  fraction  of 
the  followup  period  spent  in  nursing  homes. 

Only  8  to  16  percent  of  client  controls  were  admitted  to  nursing  homes  during 
the  followup  period,  and  the  average  fraction  of  the  followup  period  spent  in 
nursing  homes  by  client  controls  was  only  4  to  5  percent.   Thus,  there  was 
little  scope  for  reductions  in  institutionalization. 

Certain  subgroups  of  the  client  population — the  very  old  (80  years 
of  age  or  older),  the  mentally  or  physically  impaired,  the  very  old  who  lived 
alone,  the  very  old  who  were  mentally  or  physically  impaired — tended  to  have 
higher  rates  of  institutionalization  than  the  demonstration  population  as  a 
whole.   However, 

•  The  demonstrations  did  not  succeed  in  significantly 
reducing  the  likelihood  of  nursing  home  admissions  for 
any  of  these  high-risk  subgroups. 

Other  Medical  Services.   There  were  essentially  no  impacts  on 
clients'  utilization  of  doctors,  nurses,  or  therapists. 

Medicare  and  Medicaid  Reimbursements.   Given  the  almost  negligible 
effects  of  the  demonstrations  on  time  spent  in  hospitals  and  nursing  homes, 
major  reductions  in  Medicare  and  Medicaid  reimbursements  could  not  be 
expected. 
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Only  in  New  Jersey  were  Medicare  reimbursements 
significantly  reduced,  by  $240  per  client  served  per 
quarter  (relative  to  a  control  mean  of  $1599).   Three- 
quarters  of  this  decline  was  due  to  a  significant 
decrease  in  hospital  reimbursements. 

Only  in  Arkansas  and  South  Carolina  were  there 
significant  reductions  in  Medicaid  reimbursements — of 
$40  and  $59,  respectively,  per  client  per  quarter 
(relative  to  control  means  of  $81  and  $251,  respectively) 


Health  and  Functioning.   The  demonstrations  had  significant 
beneficial  effects  on  several  measures  of  client  health  and  functioning,  and 
on  unmet  client  needs. 

•  There  were  significant  decreases  in  the  a'^erage  number 
of  Activities  of  Daily  Living  (ADL)  and  Instrumental 
Activities  of  Daily  Living  (lADL)  in  which  more  help  was 
needed;  and  in  the  proportions  of  clients  experiencing 
unmet  need  for  medical  appliances,  for  in-home  medical 
equipment,  or  for  skilled  health  services. 

•  At  reassessment,  service  clients  were  totally  dependent 
in  significantly  fewer  ADL  and  lADL  than  client 
controls,  had  significantly  better  mental  orientation, 
and  were  significantly  less  likely  to  report  that  a 
specific  medical  condition  had  gotten  worse. 

•  Service  clients  were  significantly  more  likely  than 
client  controls  to  rate  their  own  health  higher  at 
reassessment  than  they  had  at  initial  assessment. 

Effects  on  Trainees 

Employment  and  Earnings.   Positive  demonstration  effects  on  overall 
trainee  employment  and  earnings  were  expected  from  two  sources:   directly, 
from  participation  in  subsidized  employment,  and  indirectly,  from  increased 
success  in  regular  (nondemonstration)  employment.   In  six  of  the  seven  states 
(all  except  New  York)  the  demonstrations  had  the  expected  effect  on  earnings. 


Over  the  entire  followup  period  in  these  six  states, 
the  increase  in  total  monthly  earnings  (including  both 
demonstration  and  nondemonstration  earnings)  ranged 
from  $122  to  $216,  representing  increases  of  56  to  131 
percent. 
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•  For  the  period  of  demonstration  participation,  total 
monthly  earnings  gains  ranged  from  $96  to  $141  per 
training  entrant. 

•  For  Pos tdemonstrat ion  Year  I,  when  most  trainees  had 
left  subsidized  employment,  cotal  monthly  earnings 
gains  ranged  from  $63  to  $215  per  training  entrant. 
For  Postdemonstrat ion  Year  2,  they  were  still  positive 
and  significant  in  five  states,  ranging  from  $102  to 
$216  per  training  entrant. 

•  Nondemonstration  earnings  in  Postdemonstration  Year  1 
increased  significantly  in  four  states,  with  gains 
ranging  from  $26  to  $81  per  training  entrant. 

•  Nondemonstration  earnings  in  Postdemonstration  Year  2 
increased  in  five  states,  ranging  from  $101  to  $215  per 
training  entrant.   Thus,  the  trend  in  nondemonstration 
earnings  gains  did  not  typically  decline  over  the 
followup  period. 

•  For  nondemonstration  jobs,  effects  on  the  percent 
employed,  hours  worked  per  month  and  hourly  wage  rate 
were  positive  in  four  states  during  Postdemonstration 
Year  1  and  in  four  to  five  states  (and  somewhat  larger) 
in  Postdemonstration  Year  2. 

Public  Benefits.   The  overall  effects  of  the  demonstrations  on 
public  benefits  were  consistent  with  the  effects  on  total  earnings. 

•  All  seven  states  moved  a  significant  proportion  of 
trainees  off  AFDC.   In  four  of  the  seven  states,  the 
reductions  in  the  proportion  of  trainees  receiving  AFDC 
in  a  typical  month  were  between  25  and  40  percentage 
points.   The  average  benefit  amount  received  from  AFDC 
was  reduced  in  six  of  the  seven  states. 

•  In  four  states,  the  demonstrations  moved  significant 
proportions  of  demonstration  trainees  out  of  the  Food 
Stamp  Program  and  reduced  the  average  food  stamp 
benefit  amount. 

Average  Medicaid  benefits  over  the  evaluation  followup  period  as  a 
whole  were  not  significantly  affected  in  any  of  the  states,  at  least  in  part 
because  Medicaid  eligibility  for  trainees  was  automatically  extended  to  cover 
the  period  of  subsidized  employment. 


Public  benefit  savings  attributable  to  demonstration  participation 
can  be  expected  to  decline  over  time.   Control  group  members  can  be  expected 
to  leave  the  welfare  rolls  through  natural  caseload  turnover,  reducing  the 
scope  for  benefit  savings,  and  demonstration  trainees  may  return  to  welfare. 

•  The  demonstrations'  effects  on  AFDC  and  food  stamp 
benefits  peaked  in  Postdemonstration  Year  1.   At  the 
end  of  the  followup  period  (30  months)  positive 
AFDC/food  stamp  benefit  savings  were  still  evident 
in  four  states. 

Trainee  Applicant  Characteristics,  Selection,  and  Performance.   In- 
take worker  assessments  of  applicants'  potential  as  homemaker-home  health 
aides  were  analyzed  in  an  attempt  to  identify  characteristics  or  measures 
which  could  be  used  ex  ante  to  predict  subsequent  trainee  performance. 

•  Intake  workers'  assessments  of  trainee  potential 
were  weak  predictors  of  performance  in  training  and 
had  no  value  as  predictors  of  performance  in 
subsidized  employment. 

•  Trainees  with  higher  ratings  of  potential  had 
consistently  higher  earnings  and  lower  AFDC  and  food 
stamp  benefits  regardless  of  whether  they  were 
assigned  to  the  training  or  control  groups. 

•  Intake  workers'  ratings  had  little  value  for 
selecting  those  applicants  who  would  benefit  most 
from  the  demonstration  program. 

Benefits  and  Costs 

Did  the  benefits  achieved  by  the  demonstrations  exceed  the  value  of 
the  additional  resources  (net  of  evaluation  costs)  required  to  provide  ser- 
vices to  clients  and/or  to  train  and  employ  the  aides?   We  first  examine  the 
benefits  and  costs  of  the  client  (service)  component  taken  by  itself  and  the 
trainee  (training  and  employment)  component  taken  by  itself,  to  determine  the 
net  benefits  that  would  be  derived  if  either  component  were  implemented 
separately.   We  then  examine  the  net  benefits  of  the  two  components 
implemented  jointly,  as  they  were  in  the  demonstrations. 
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TABLE  S.l.   NET  BENEFITS  OF  CLIENT  COMPONENT 
(dollars  per  hour  of  service) 


Clients  and 
Society Informal  Caregivers Taxpayers 


Arkansas 

Kentucky 

New  Jersey 

New  York 

Ohio 

South  Carolina 

Texas 


-24.53 

-18.80 
-9.76 

-20.10 
-2.87 
-4.28 

-13.93 


.56 
1.36 
.80 
.26 
.98 
.73 
.36 


-25.09 
-20.16 
-10.56 
-20.36 
-3.85 
-5.01 
-14.29 


Client  Component  Alone »   In  none  of  the  seven  states  did  the  client 
component  achieve  positive  net  benefits  to  society  as  a  whole  (see  Table  S.l). 
This  was  due  primarily  to  the  failure  of  expected  reductions  in  institu- 
tionalization to  materialize. 

•  From  society's  perspective,  the  net  costs  of  the  client 
component  ranged  from  $2.87  per  hour  of  service  to  $24.53  per 
hour  of  service. 

•  Clients  achieved  small  benefits,  primarily  from  reduced  costs  of 
formal  in-home  care. 

•  Taxpayers  paid  the  costs,  ranging  from  $3.85  to  $25.09  per  hour 
of  service. 

•  The  major  costs  were  the  operational  costs,  ranging  from  $6.71 
to  $26.87  per  hour  of  service — typically  substantially  more  than 
the  Medicare  cost  limits  for  home  health  aide  services. 

•  Against  these  costs  must  be  assessed  the  modest  beneficial 
effects  on  client  health  status  and  functioning. 
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TABLE  S.2.   NET  BENEFITS  OF  TRAINEE  COMPONENT 
(dollars  per  training  entrant) 


Society Trainees Taxpayers 


Arkansas 

Kentucky 

New  Jersey 

New  York 

Ohio 

South  Carolina 

Texas 


2,226 

-3,319 

5,545 

3,858 

7,820 

-3,962 

12,961 

16,670 

-3,709 

-3,594 

4,254 

-7,848 

12,208 

10,335 

1,873 

9,483 

1,986  - 

7,497 

5,604 

9,342 

-3,738 

Trainee  Component  Alone.   In  six  of  the  seven  states,  the  trainee 
component  achieved  substantial  net  social  benefits  (see  Table  S.2).   For  these 
six  states: 

•  From  society's  perspective,  the  net  benefits  of  the 
trainee  components  ranged  from  $2,226  to  $12,961  per 
training  entrant. 

•  The  net  benefits  went  primarily  to  the  trainees  in 
all  states  except  one,  with  trainee  benefits  ranging 
from  $1,986  to  $16,670. 

•  The  taxpayers  gained  in  three  states,  and  paid  net 
costs  in  four. 

•  The  largest  social  benefit  in  almost  all  states 
was  the  increase  in.nondemonstration  earnings  of 
trainees;  estimated  lifetime  earnings  gains  ranged 
from  $2,181  to  $18,962  per  training  entrant. 

•  The  largest  social  costs  in  almost  all  states  were 
the  operational  costs,  ranging  from  $4,299  to  $8,688 
per  training  entrant. 
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TABLE  S.3.   NET  BENEFITS  OF  CLIENT  AND  TRAINEE  COMPONENTS  COMBINED 

(dollars  per  hour  of  service) 


Society 


Clients 


Trainees Taxpayers 


Arkansas 

Kentucky 

New  Jersey 

New  York 

Ohio 

South  Carolina 

Texas 


-9.67 
-4.47 
15.75 
-40.00 
13.47 
-.39 
-3.68 


.56 

-10.96 

.73 

1.36 

16  -:9 

-22.42 

.80 

30.72 

-15.77 

.26 

37.02 

-77.28 

.98 

13.60 

-1.11 

.73 

1.67 

-2.79 

.36 

18.85 

-22.89 

Client  and  Trainee  Components  Combined.   In  only  two  states  did  the 
demonstration  as  a  whole  achieve  positive  net  social  benefits  (see  Table  S.3), 

•  Those  two  stares  achieved  positive  net  benefits  of 
$13.47  and  $15.75  per  hour  of  service. 

•  The  social  costs  in  the  other  five  states  ranged 
from  $.39  to  $40.00  per  hour  of  service. 

•  Clients  reaped  minor  monetary  net  benefits — less 
than  $1.50  per  hour  of  service. 

•  Trainees  received  net  benefits  (including  estimated 
future  earnings  gains)  in  six  of  the  seven  states, 
ranging  from  $1.67  to  $37.02  per  hour  of  service. 

•  Taxpayers  bore  net  costs  in  six  of  the  seven  states, 
ranging  from  $1.11  to  $77.28  per  hour  of  service. 

In  return  for  these  taxpayer  costs,  trainees  received  substantially 
increased  earnings;  clients  benefited  from  improved  mental  and  physical 
functioning  and  reduced  unmet  need;  and  taxpayers  derived  the  satisfaction  of 
knowing  that  aged  and  impaired  clients  were  being  cared  for,  and  that  former 
welfare  recipients  were  and  are  working.   Whether  these  benefits  are  worth 
their  cost  to  taxpayers  is,  in  the  end,  a  question  for  policymakers  and  the 
public  to  answer. 
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I.   OPERATION  OF  THE  DEMONSTRATIONS,  EVALUATION  METHODOLOGY,  AND  DATA  SOURCES 

The  AFDC  Homemaker-Home  Health  Aide  Demonstrations  were  designed  to 
test  the  feasibility  of  training  AFDC  recipients  to  provide  homemaker-home 
health  aide  services  to  functionaLIy  impaired  persons  in  their  own  homes.   The 
Omnibus  Budget  Reconciliation  Act  of  1980  authorized  the  Secretary  of  Health 
and  Human  Services  to  enter  into  agreements  with  a  number  of  states  to  conduct 
such  demonstration  projects.   The  Secretary  designated  the  Health  Care 
Financing  Administration  (HCFA)  as  the  lead  agency  for  implementing  the 
demonstrations,  and  demonstration  grants  were  ultimately  awarded  to  seven 
states:   Arkansas,  Kentucky,  New  Jersey,  New  York,  Ohio,  South  Carolina,  and 
Texas.   The  first  state  project  began  operations  in  January  1983  and  the 
demonstrations  ran  until  June  30,  1986. 

The  demonstrations  had  two  components,  corresponding  to  the  two 
goals  of  reducing  welfare  dependence  by  giving  AFDC  recipients  a  marketable 
skill  and  work  experience,  and  of  reducing  institutionalization  among 
clients. 

The  first  component  was  a  four-to  eight-week  period  of  formal 
homemaker-home  health  aide  training  for  AFDC  recipients,  followed  by  up  to  a 
year  of  subsidized  employment.   The  second  component  was  provision  by  the 
demonstration  trainees  of  up  to  100  hours  per  month  of  homemaker  and  home 
health  aide  services  to  individuals  in  need  of  long  term  care.   Participation 
in  each  component  was  voluntary.   To  allow  rigorous  evaluation,  eligible 
trainee  and  client  applicants  were  randomly  assigned  to  a  treatment  or  control 
group.   Demonstration  effects  are  measured  as  the  differences  in  outcomes 
between  the  treatment  and  control  group  members. 

Abt  Associates  Inc.  is  under  contract  with  HCFA  and  the  seven 
demonstration  states  to  evaluate  the  effects  of  the  demonstrations  on  clients 
and  trainees.   This  is  the  final  evaluation  report,  summarizing  the  effects  of 
the  demonstrations.   The  Technical  Reports  on  which  it  is  based  are  listed  at 
the  end  of  this  report.   The  rest  of  Chapter  I  provides  a  brief  overview  of 
the  organization  and  functioning  of  the  demonstrations,  the  evaluation 
methodology,  and  data  sources.   Chapter  II  presents  the  demonstration  impacts 
on  clients*  receipt  of  formal  in-home  services  and  informal  care,  institu- 
tionalization, use  of  other  medical  services,  functioning,  health  status,  and 


well-being.   Chapter  III  presents  impacts  on  trainee  earnings,  employment,  and 
public  benefit  receipt,  and  discusses  how  trainee  outcomes  may  have  been 
affected  by  the  trainee  selection  process.   Chapter  IV  presents  estimated 
benefits  and  costs  of  the  two  components  of  the  demonstrations  separately  and 
in  combination.   Chapter  V  discusses  the  conclusions  and  implications  to  be 
drawn  from  the  demonstrations. 

Overview  of  the  Demonstrations 

Within  each  of  the  seven  demonstration  states,  the  demonstration  was 
implemented  in  selected  local  areas,  or  sites.   As  shown  in  Table  I.l,  the 
number  of  sites  in  each  state  ranged  from  A  in  Texas  to  20  in  South 
Carolina.   In  most  states,  the  sites  were  individual  counties  or  cities.    The 
7  sites  in  Arkansas  encompassed  28  (largely  rural)  counties,  and  Kentucky's  10 
sites  were  Area  Development  Districts,  each  encompassing  several  counties. 

Following  a  six-month  planning  phase,  demonstration  operations  began 
in  January  1983,  with  the  enrollment  of  the  first  trainees  in  Arkansas. 
Trainee  enrollment  in  Kentucky,  New  Jersey,  and  Texas  begin  in  February  1983, 
and  in  Ohio  and  South  Carolina  in  April  1983.   In  each  of  these  states, 
enrollment  of  clients  began  one  to  three  months  later,  as  the  first  classes  of 
trained  aides  entered  subsidized  employment.   Implementation  in  New  York  was 
substantially  delayed  by  protracted  contract  negotiations  with  local  provider 
agencies  and  extended  negotiations  between  the  state  and  HCFA  regarding  client 
eligibility  criteria.   In  that  state,  the  first  trainee  was  enrolled  in  August 
1983,  and  the  first  client  was  not  enrolled  until  July  1984,  nearly  a  year 
later.   In  the  interim,  demonstration  aides  served  nondemonstration  clients, 
under  nondemonstration  funding. 

Under  demonstration  guidelines,  each  state  was  allowed  to  train  up 
to  300  aides  in  the  first  year.   Three  states  (Arkansas,  Kentucky,  and  South 
Carolina)  set  substantially  lower  training  targets  in  recognition  of  the 
anticipated  difficulties  of  recruiting,  training,  and  employing  the  aides  in 
their  predominantly  rural  sites.   The  total  numbers  of  AFDC  recipients 
entering  training  over  the  three  years  of  each  demonstration  (shown  in  the 
fourth  column  of  Table  I.l)  reflect  these  differences  in  the  planned  scale  of 


A  complete  list  of  demonstration  sites  is  provided  in  the  Appendix, 


Table  I. 1   Timing  and  Size  of  the  Demonstration  Projects 


Number 
of  Sites 

Startup 

Date 

Project  Size 

Training 
Entrants 

Clients 

Trainees 

Clients 

Served 

Arkansas 

7 

1/83 

4/83 

447 

772 

Kentucky 

10 

2/83 

4/83 

431 

2,004 

New  Jersey 

5 

2/83 

3/83 

887 

1,626 

New  York 

5 

8/83 

7/84 

355 

207 

Ohio 

19 

3/83 

4/83 

694 

2,806 

South  Carolina 

20 

3/83 

4/83 

455 

961 

Texas 

4 

2/83 

5/83 

751 

1,163 

demonstration  activities,  as  well  as  the  delayed  implementation  in  New  York. 
In  total,  about  700  to  900  AFDC  recipients  entered  training  in  each  of  the 
projects  in  New  Jersey,  Ohio,  and  Texas.   The  three  predominantly  rural 
states — Arkansas,  Kentucky,  and  South  Carolina — each  enrolled  about  450 
trainees  over  the  course  of  the  demonstration.   In  New  York,  there  were  about 
350  training  entrants. 

The  total  numbers  of  clients  served  varied  among  the  demonstration 
projects  both  because  of  these  differences  in  the  number  of  aides  trained  and 
because  of  differences  in  the  number  of  clients  served  by  each  aide.   Client- 
aide  ratios  varied  from  approximately  two  to  one  in  Arkansas,  South  Carolina, 
and  Texas  to  over  four  to  one  in  Kentucky.   Moreover,  as  noted.  New  York  did 
not  begin  serving  demonstration  clients  until  nearly  a  year  after  the  first 
demonstration  traiaees  were  enrolled.   The  resulting  numbers  of  clients  served 
are  shown  in  the  last  column  of  Table  I.l.   The  three-year  totals  range  from 
207  clients  in  New  York  to  more  than  2,800  in  Ohio.   Kentucky  and  New  Jersey 
were  near  the  high  end  of  the  range,  serving  about  2,000  and  1,600  clients, 
respectively.   Arkansas  served  nearly  800  clients,  South  Carolina  nearly 
1,000,  and  Texas  about  1,200. 

The  authorizing  legislation  and  subsequent  HCFA  guidelines  set 
overall  parameters  that  governed  the  client  and  trainee  components  of  the 
demonstrations  as  follows: 

•  The  service  component  consisted  of  homemaker-home  health 
aide  services  provided  on  a  part-time,  intermittent  basis 
(not  exceeding  100  hours  a  month)  to  elderly,  disabled,  or 
other  individuals  who  would  be  at  risk  of 
institutionalization  without  such  services,  and  who  did 
not  have  nondemonstration  services  reasonably  available  to 
them.   Clients  with  incomes  above  200  percent  of  the  state 
AFDC  needs  standard  contributed  to  the  cost  of  their  care 
according  to  a  state-specific  sliding  fee  scale  based  on 
income. 

•  The  service  providers  were  to  be. public  or  private 
nonprofit  agencies. 

•  There  was  to  be  a  periodic  Independent  Professional  Review 
(IPR)  to  assess  continuing  client  eligibility  for  service 
and  to  make  sure  that  appropriate  services  were  being 
delivered. 


^Section  966  of  the  Omnibus  Budget  Reconciliation  Act  of  1980 
*(P.L.  96-499). 


To  be  eligible  for  the  training  and  employment  component, 
which  was  voluntary,  potential  trainees  must  have  been 
AFDC  recipients  for  theprevious  90  days  and  not  employed 
as  aides  during  that  time.   The  training  period  of 
4-8  weeks  was  followed  by  up  to  a  year  of  subsidized  fuLI- 
time  employment,  during  which  Medicaid  coverage  continued, 
wages  comparable  to  those  received  by  nondemonstrat ion 
aides  were  paid,  and  work-reLated  support  services  were 
provided. 

Each  state  was  allowed  to  train  up  to  300  aides  during  the 
first  year. 

The  training  agencies  were  to  be  public  or  private 

nonprofit  institutions. 

It  was  intended  that  demonstration  aides  would  serve 
demonstration  clients.   To  allow  some  operational 
flexibility,  however,  up  to  10  percent  of  the  clients* 
services  could  be  provided  by  nondemonstration  aides,  and 
demonstration  aides  were  allowed  to  devote  up  to  10 
percent  of  their  service,  hours  to  nondemonstration 
clients. 


Within  these  overall  demonstration  parameters,  it  was  left  to  each 
state  to  design,  plan,  implement,  and  run  its  homemaker-home  health  aide 
project.   The  seven  demonstration  projects  therefore  shared  a  basic  similarity 
but  also  differed  along  a  number  of  dimensions.   Each  state  could  impose  its 
own  additional  criteria  for  inclusion  of  clients  and  trainees  into  the 
program,  and  devise  its  own  procedures  and  policies  with  respect  to  outreach 
methods,  training,  and  service  provision. 

Client  Functions 

The  objective  of  the  client  (service)  component  was  to  implement 
outreach  and  assessment  procedures  to  identify  eligible  clients  and  to  provide 
them  with  homemaker-home  health  aide  services.   The  four  major  client 
functions — outreach,  assessment,  service  provision,  and  IPR — are  described  in 
turn. 


The  description  that  follows  is  taken  from  Cella,  Operational  Costs 
of  Demonstration  Activities  (1987). 


Outreach.   The  client  outreach  function  was  typically  performed  by 
demonstration  provider  agencies  or  regional  or  county  staff  of  social  service 
departments.   In  some  states,  this  process  was  shared  by  both  types  of 
agencies  (New  Jersey,  New  York,  Ohio);  in  others,  only  one  or  the  other  type 
of  agency  was  used.   The  major  exception  was  Arkansas,  where  state  demon- 
stration staff  located  in  field  offices  performed  this  function. 

The  primary  outreach  methods  used  by  all  the  states  were  meetings  of 
demonstration  staff  with  long  term  care  and  social  service  agency  repre- 
sentatives in  groups  or  individually,  and  mailings  to  agencies.   Each  state 
made  a  strong  effort  to  develop  a  referral  network  of  agencies  and  individuals 
who  were  in  routine  contact  with  potential  clients.   South  Carolina  was  most 
successful  in  this,  holding  regular  meetings  with  interagency  councils 
(composed  of  representatives  of  local  long  term  care  agencies)  in  each  site, 
developed  by  demonstration  staff  to  generate  appropriate  referrals;  another 
long  term  care  program,  the  Community  Long  Term  Care  Project,  also  acted  as  an 
important  referral  source  in  that  state. 

A  wide  range  of  outreach  methods  was  used  by  the  states  to 
supplement  the  primary  methods.   Newspaper,  television,  or  radio  publicity  was 
used  to  some  extent  in  all  states.   And  all  states  except  Arkansas  sent 
mailings  to  potential  clients,  using  nursing  home  and  home  health  agency 
mailing  lists  as  well  as  other  lists  of  potential  applicants. 

Intake.   The  referral  process  typically  began  with  a  brief  telephone 
call  from  potential  clients  or  their  representatives  to  the  local 
demonstration  agency  (provider  agency  or  local  welfare  agency).   At  this  time, 
a  brief  preliminary  screening  interview  was  conducted  using  a  standard  set  of 
criteria  to  determine  if  the  client  met  the  major  eligibility  requirements 
imposed  by  the  legislation  and  HCFA  guidelines.   Those  clients  who  appeared  to 
be  eligible  for  demonstration  services  based  on  the  screening  criteria  and  any 
additional  information  obtained  over  the  phone  were  scheduled  for  an  inperson 
assessment . 

Assessment .  Client  assessments  were  inperson  interviews  by  trained 
assessors — designed  to  determine  an  applicant's  health  and  functional  status, 
availability  of  support  services,  eligibility  for  demonstration  services,  and 
the  nature  and  level  of  services  needed.  As  with  outreach,  this  function  was 
carried  out  in  some  states  by  provider  agencies,  and  in  others  by  county 


social  service  departments.   South  Carolina  used  county  department  staff;  New 
Jersey  and  Texas  relied  on  providers;  New  York  and  Ohio  used  a  combination  of 
the  two.   Arkansas  and  Kentucky  delegated  assessments  to  the  same  agencies 
that  performed  client  outreach  and  screening — state  demonstration  staff 
located  in  field  offices,  and  regional  social  service  department  staff  located 
in  the  Area  Development  Districts  (ADDS),  respectively. 

Initially,  assessment  staff  received  a  three-day  training  session 
designed  and  conducted  by  the  evaluation  contractor;  at  least  one  additional 
session  was  held  in  each  state  over  the  course  of  the  demonstration.   Provider 
agency  supervisory  staff  or  state  staff  were  responsible  for  additional  formal 
training  as  new  staff  were  hired. 

In  all  seven  states,  the  inperson  assessment  used  a  detailed  formal 
instrximent  called  the  Client  Assessment  Instrument  (CAI),  designed  by  the 
evaluation  contractor.   This  form  collected  data  on  clients'  functional  status 
and  orientation,  informal  care  resources,  recent  institutionalization,  medical 
conditions,  financial  resource,  and  other  relevant  data.   On  the  basis  of  the 
CAI,  the  final  eligibility  decision  was  made  either  by  the  assessors 
themselves  or  by  their  supervisors.   The  names  of  eligible  applicants  were 
then  forwarded  to  state  demonstration  staff  to  be  submitted  to  the  evaluation 
contractor  for  random  assignment  to  either  the  service  or  control  group.   The 
only  exception  to  this  was  Texas,  where  names  were  submitted  for  random 
assignment  directly  from  the  agencies  at  the  sites.   Clients  were  notified  of 
their  status  (service  or  control  group)  through  various  methods.   Four  states 
used  letters;  Kentucky  and  New  York  used  a  combination  of  letters  and 
telephone  calls;  Ohio  used  a  combination  of  letters,  telephone  calls,  and 
personal  contacts. 

The  number  of  assessors  per  site  and  their  backgrounds  varied  within 
and  across  states.   Typically,  sites  had  2-3  assessors  who  performed  other 
duties  in  addition  to  assessments.   Ohio  averaged  4  assessors  per  agency,  as 
did  South  Carolina,  where  there  were  as  many  as  11  assessors  in  one  site. 
Kentucky  generally  had  one  assessor  in  each  region. 

Service  Provision.   Most  of  the  agencies  providing  services  to 
demonstration  clients  were  established  service  providers.   They  fell  into 
several  categories:  state  or  local  public  agencies;  private  agencies,  whose 
primary  function  was  providing  in-home  services;  and  private  agencies  with 


other  primary  functions,  such  as  coordination  of  programs  for  the  aging  or 
social  services.   In  Arkansas,  services  were  provided  by  Local  units  of  the 
state  health  department.   Kentucky  contracted  with  various  types  of  providers, 
including  local  health  departments,  home  health  agencies,  and  others  (such  as 
family  service  and  senior  citizens'  organizations).   New  Jersey  contracted 
with  a  range  of  providers,  including  a  county  social  service  agency  and 
organized  home  care  agencies.   New  York  used  Visiting  Nurse  Associations, 
family  service  agencies,  and  other  private  home  health  provider  agencies. 
Most  Ohio  provider  agencies  were  nonprofit  social  service  agencies,  homemaker- 
home  health  aide  agencies,  or  county  health  departments;  two  county  welfare 
departments  also  functioned  as  service  providers.   South  Carolina  contracted 
with  a  large  regional  medical  center  for  service  provision  in  five  counties, 
and  with  local  councils  on  aging  in  the  other  sites.   The  local  project  sites 
in  Texas  contracted  primarily  with  home  health  agencies,  both  public  and 
private,  for  demonstration  service  provision.   In  two  sites  these  were  city 
departments  already  providing  homemaker  services;  in  the  other  two  sites,  the 
cities  administering  the  project  contracted  with  private  home  care 
providers. 

Services  to  clients  included  homemaker  services  and  personal  care 
assistance.   During  aide  visits  clients  might  also  receive  health  care 
assistance  or  home  management  services.   As  noted,  the  demonstration  guide- 
lines set  a  limit  of  100  hours  of  service  per  client  per  month.   Reassessments 
were  conducted  on  clients  at  the  discretion  of  the  provider  agencies; 
generally  this  procedure  was  initiated  by  agencies  as  a  monitoring  device  to 
ensure  quality  and  appropriateness  of  care. 

Independent  Professional  Review  (IPR).   The  IPR  was  designed  to 
monitor  client  eligibility  and  the  appropriateness  and  quality  of  service 
delivered  to  clients.   This  function  is  not  dissimilar  to  quality  assurance  or 
peer  review  activities  performed  by  state  Medicaid  agencies  nationwide. 
Guidelines  specified  both  a  record  review  on  a  20  percent  sample  of  clients 
and  an  in-home  review  of  a  5  percent  sample  of  active  cases,  to  be  conducted 
each  quarter.   The  IPR  function  was  operationally  separate  from  staff  who 
oversaw  the  demonstration  itself  and  from  service  provision,  in  order  to 
preserve  its  independence  from  demonstration  operations.   Most  states  staffed 
the  IPR  function  with  a  combination  of  Registered  Nurses  and  social  workers  on 
a  part-time  basis. 
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Trainee  Functions 

The  trainee  component  solicited  applicants  for  demonstration 
training,  selected  from  among  the  eligible  applicants,  provided  formal 
homemaker-home  health  aide  training,  and  employed  the  trained  aides  on  a 
subsidized  basis  for  up  to  12  months.   Each  of  these  functions  is  described  in 
turn. 

Outreach  and  Selection.   In  two  of  the  states,  Arkansas  and  South 
Carolina,  the  demonstration  projects  had  centralized  organizational 
structures.   State  project  staff  took  the  lead  responsibility  for  most  of  the 
training  functions.   In  the  other  five  states  the  trainee  outreach  and 
selection  process  was  more  decentralized,  with  project  staff  in  either  local 
welfare  agencies  (New  Jersey,  Ohio,  and  Texas),  local  districts  (New  York),  or 
social  service  agencies  (Kentucky)  assuming  the  lead  responsibility  for  all 
related  tasks.   In  each  state,  the  responsible  staff  generated  lists  of 
AFDC  recipients  who  were  contacted  and  encouraged  to  apply  to  the  demonstra- 
tion.  In  most  states  and  sites,  these  trainee  outreach  activities  were 
scheduled  to  precede  scheduled  training  classes;  however,  in  some  sites, 
training  classes  were  held  virtually  continuously,  requiring  that  outreach 
also  be  more  or  less  continual.   Outreach  waves  lasted  from  as  little  as 
2  weeks  to  as  much  as  8-10  weeks,  with  outreach  staff  typically  working  only 
part  time  on  these  activities. 

Mass  mailings  were  the  typical  outreach  method  used,  except  in 
Kentucky,  which  relied  on  an  equal  combination  of  letters  and  telephone 
contacts.   Additional  outreach  methods  were  employed  to  supplement  the 
mailings  in  all  states  except  South  Carolina.   These  additional  methods 
included  telephone  and  inperson  contacts,  media  advertising,  and  brochures. 
The  extent  to  which  additional  outreach  methods  were  used  increased  as  the 
demonstration  progressed,  particularly  in  those  sites  which  scheduled  multiple 
training  sessions. 

A  variety  of  mechanisms  were  employed  through  which  AFDC  recipients 
could  express  interest  in  the  demonstration.   In  two  states,  Arkansas  and 
Ohio,  reply  forms  were  included  with  the  original  mailing.   New  York  and  Texas 
encouraged  interested  parties  to  contact  their  caseworker  or  local  welfare 
office.   Attendance  at  group  orientation  meetings  served  as  the  main  response 
vehicle  in  Kentucky,  South  Carolina,  and  two  sites  in  Texas.   New  Jersey  used 


a  combination  of  all  three  response  mechanisms — response  forms,  telephone 
calls,  and  invitations  to  group  meetings. 

All  interested  recipients  were  required  to  go  through  a  personal 
interview  process.   In  those  sites  where  group  meetings  were  held,  this 
process  was  two-tiered,  beginning  with  the  orientation  meeting.   Those 
recipients  who  did  not  screen  themselves  out  of  the  demonstration  during  the 
orientation  were  invited  to  complete  an  application  and  enter  into  the  second 
tier — the  personal  interview.   This  interview  took,  place  immediately  following 
the  group  session  in  the  states  where  trainee  selection  was  primarily  a 
demonstration  staff  responsibility.   In  those  states  where  the  provider 
agencies  played  significant  roles  in  the  selection  process  (Kentucky,  New 
Jersey,  New  York,  and  El  Paso,  Texas),  applicants  were  sometimes  interviewed 
separately  by  demonstration  and  provider  agency  staff  over  several  days. 

The  names  of  applicants  who  met  all  the  eligibility  requirements  and 
were  deemed  acceptable  for  training  were  forwarded  to  state  staff,  who  trans- 
mitted them  by  telephone  to  the  evaluation  contractor  for  random  assignment. 
(In  Texas  names  were  submitted  directly  by  the  local  demonstration  staff.) 
Half  the  applicants  were  randomly  assigned  to  training  and  the  other  half  were 
assigned  to  a  control  group,  which  made  them  ineligible  to  receive 
demonstration  services. 

During  the  period  of  ongoing  demonstration  operations,  the  elapsed 
time  between  initial  outreach  and  final  selection  and  assignment  of  trainees 
was,  on  average,  5  to  6  weeks.   The  interval  between  application  and  screening 
(via  the  interview)  averaged  three  days;  between  screening  and  random 
assignment,  about  two  weeks.   The  typical  trainee  waited  three  weeks  after 
assignment  before  entering  training.   In  Arkansas,  Kentucky,  New  York,  South 
Carolina,  and  Texas,  about  one  month  elapsed  from  the  point  of  application  to 
the  start  of  training.   In  New  Jersey  the  lag  averaged  42  days.   In  Ohio  it 
averaged  71  days. 

Training.   AFDC  recipients  assigned  to  the  training  group  received 
training  that  consisted  of  both  classroom  and  practicum  components.   Training 
was  provided  by  both  public  and  private  agencies.   New  Jersey  and  New  York 
used  primarily  service  providers  as  training  agencies;  Arkansas,  South 
Carolina,  and  Ohio  used  primarily  public  and  private  vocational  technical 
schools.   Kentucky  used  individual  instructors  teaching  under  the  auspices  of 
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a  vocational  technical  school.   Texas  used  service  providers  and  community 
colleges  about  equally.   In  most  states,  the  demonstration  included  both 
agencies  that  trained  only  demonstration  aides  and  agencies  that  trained  other 
aides  as  well,  although  in  the  typical  situation  separate  classes  were  held 
for  demonstration  aides.   The  two  exceptions  were  Arkansas,  where  training 
agencies  trained  demonstration  aides  only  and  New  York,  where  all  training 
agencies  trained  both  demonstration  and  nondemonstration  aides  and  joint 
classes  were  the  norm. 

The  training  curriculum  varied  by  state,  but  virtually  all  sites 
used  the  Model  Curriculum  developed  by  the  National  Home  Caring  Council  as  the 
basic  framework  for  training.   Supplemental  texts  were  used  in  many  instances, 
and  many  sites  added  segments  devoted  to  subjects  not  covered  in  the  model 
curriculum.   The  average  length  of  classroom  training  was  121  hours  over  four 
to  five  weeks.   Only  New  York  and  South  Carolina  reported  using  no  additional 
materials  or  texts,  and  these  two  states  had  the  shortest  training  sessions, 
lasting  60  and  87.5  hours,  respectively.   The  longest  classroom  component  was 
in  Kentucky,  where  the  trainees  averaged  191  hours  over  a  seven-week  span. 
The  practicum,  which  provided  trainees  with  hands-on  experience  in  nursing 
homes  and/or  in  private  homes,  averaged  about  26  hours  over  all  states 
together,  spanning  a  range  from  12-13  hours  in  New  Jersey  and  Arkansas  to 
48  hours  in  Texas.   One  site  in  Texas  provided  from  one  to  four  weeks  of 
practicum  based  on  the  needs  of  the  individual  trainee. 

Subsidized  Employment.   Trained  aides  were  generally  employed  by 
established  home  care  providers — public  agencies.  Medicare-certified  home 
health  agencies,  private  nonprofit  homemaker-home  health  aide  agencies.   In 
Arkansas,  aides  were  hired  by  local  units  of  the  state  health  department. 
Kentucky  contracted  with  various  types  of  providers — including  local  health 
departments,  home  health  agencies,  and  others  such  as  family  service  (primary 
health  care)  and  senior  citizens*  organizations — some  of  which  served  only 
small  numbers  of  demonstration  clients.   New  Jersey  contracted  with  a  range  of 
providers,  including  a  county  social  service  agency  and  organized  home  care 
agencies.   Most  Ohio  provider  agencies  were  nonprofit  social  service  agencies, 
homemaker-home  health  aide  agencies,  or  county  health  departments;  two  county 


See  Orr  et  al.   Second  Annual  Report;   Cross-State  Analysis  (1984) 
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welfare  departments  also  functioned  as  provider  agencies.   South  Carolina 
contracted  with  a  large  medical  center  for  service  provision  in  five  counties, 
and  with  local  Councils  on  Aging  in  the  other  areas.   In  Texas  the  local 
projects  contracted  primarily  with  home  health  agencies,  both  public  and 
private,  for  service  provision.   In  two  sites,  these  were  city  departments 
already  providing  homemaker  services;  in  the  other  two  sites,  the  cities 
contracted  with  private  home  care  providers. 

Aides'  wages  averaged  $3.84  per  hour;  the  two  most  rural  states, 
Arkansas  and  South  Carolina,  paid  aides  the  minimum  wage  ($3.35);  New  Jersey 
and  Ohio  paid  wages  over  $4.00  per  hour  on  average.   Aides  were  employed  only 
about  three  quarters  time  on  average  during  the  first  operational  year. 
Nearly  60  percent  of  all  paid  hours  were  spent  in  service  provision;  some  of 
the  nonservice  time  was  spent  in  traveling  to  and  from  clients'  homes.   Aides 
generally  provided  homemaker  services  and  personal  care  services  during  their 
visits,  although  sometimes  visits  to  demonstration  clients  included  health 
care  assistance  or  home  management  services. 

The  typical  aide  made  about  25  three-hour  visits  each  month,  and 
served  ;our  or  five  different  clients,  although  this  varied  greatly  by 
state.   New  Jersey  typified  the  norm.   Arkansas  aides  made  an  average  of  about 
14  three-hour  visits  per  month,  serving  less  than  two  clients  on  average. 
Kentucky  aides  made  more  than  the  average  number  of  visits  (27)  for  a  shorter 
period  of  time  (less  than  two  hours)  to  six  or  seven  clients.   In  South 
Carolina,  the  typical  aide  made  34  home  health  visits  of  nearly  four  hours  in 
duration  and  served  two  different  clients  per  month.   The  aides  in  Ohio  and 
Texas  provided  visits  of  about  3  hours;  Ohio  aides  made  an  average  of 
30  visits  per  month;  Texas  aides  averaged  15.   In  New  York,  demonstration 
aides  made  20  visits  per  month,  averaging  nearly  four  hours  in  length. 

Evaluation  Methodology  and  Data  Sources 

The  basic  evaluation  methodology  was  to  use  random  assignment  of 
eligible  client  and  trainee  applicants  to  treatment  and  control  groups,  and  to 
measure  effects  as  the  difference  in  outcomes  between  service  clients  and 
client  controls,  and  between  trainees  and  trainee  controls,  respectively. 
Little  can  be  learned  based  on  outcomes  for  the  treatment  group  alone.   For 
example,  service  clients'  functioning  may  deteriorate  over  the  course  of  the 
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demonstration  as  a  result  of  aging,  not  as  a  result  of  the  demonstration.   By 
determining  whether  the  service  clients'  abilities  deteriorated  less  than  the 
abilities  of  client  controls,  we  can  measure  the  effect  of  the  demonstration 
as  distinct  from  what  would  have  happened  to  the  service  clients  in  the 
absence  of  the  demonstration.   Because  of  random  assignment,  simple  treatment- 
control  differences  will  yield  unbiased  estimates  of  demonstration  effects. 
However,  effects  on  most  outcomes  have  been  estimated  by  multiple  regression 
procedures  to  net  out  the  effects  of  measured  factors  that  are  independent  of 
the  demonstration  treatment  (for  example,  trainee  age),  in  order  to  increase 
the  precision  of  the  estimates. 

The  estimates  presented  in  this  report  are  for  the  training  entrants 
and  clients  served,  rather  than  for  all  trainees  and  clients  assigned  to  the 
treatment  groups.    These  estimates  correspond  to  the  slot  cost  of  an 
operating  program,  and  are  appropriate  measures  of  the  treatment  effect 
assuming  that  persons  not  exposed  to  the  treatment  were  unaffected  by  the 
demonstration.   Estimated  impacts  per  trainee  or  client  assigned  are  slightly 
smaller  but  have  identical  statistical  significance  levels. 

To  measure  client  impacts,  the  evaluation  collected  baseline  data  on 
personal  characteristics,  informal  support  systems,  health,  and  functioning 
through  a  detailed  inperson  assessment;  telephone  followup  survey  data  on 
nursing  home,  hospital,  and  other  health  services  utilization;  Medicare  and 
Medicaid  reimbursement  record  data;  and  followup  inperson  reassessment  data 
for  a  subsample  of  clients  on  health  status,  and  physical  and  mental 
functioning.   To  measure  trainee  impacts,  the  evaluation  collected  baseline 
application  form  data  on  trainee  characteristics  and  prior  work,  and  caregiving 
experience;  training  records  and  monthly  work  histories  during  demonstration 
participation;  nondemonstration  employment  and  earnings  data  from  a  telephone 
followup  survey;  and  state  program  record  data  on  AFDC,  food  stamp,  and 
Medicaid  benefit  receipt. 


Unbiased  estimates  of  effects  on  training  entrants  and  clients 
served  were  derived  from  the  estimated  effects  on  all  trainees  and  clients 
assigned  by  the  method  described  in  Howard  S.  Bloom,  "Accounting  for  No-Shows 
in  Experimental  Evaluation  Designs,"  Evaluation  Review,  April  1984. 
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Sample  sizes  for  four  of  the  five  major  data  collection  activities 
are  shown  in  Table  1.2.   In  addition,  an  inperson  health  status  reassessment 
was  administered  to  a  random  subsample  of  3,333  clients  and  client  controls 
initially  assessed  before  July  1,  1984.   Because  only  a  subsample  of  clients 
was  reassessed,  state-specific  sample  sizes  were  too  small  for  reliable 
analysis.   The  average  length  of  the  followup  period  for  each  of  the  different 
data  collection  activities  was  as  follows: 

Trainee  followup  survey — 22  months; 

Public  benefit  records  data — 18  months; 

Client  followup  survey — 6  and  12  months  after  assignment  (71  percent 
received  both  followup  surveys;  25  percent  received  only  the  first 
followup;  4  percent  received  only  the  second  followup); 

Client  Medicare/Medicaid  records — 13  months;  and, 

Health  status  reassessment — 20  months. 
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Table  1.2:   Sample  Sizes  by  Data  Source 
(number  of  persons  with  data) 


Trainee       Trainee  Public       Client         Client 
Followup      Benefit  Records     Followup    Medicare/Medicaid 


Survey' 


Data' 


Survey 


Data' 


Arkansas 

297 

Kentucky 

317 

New  Jersey 

774 

New  York 

181 

Ohio 

711 

South  Carolina 

474 

Texas 

707 

1,033 
893 
2,036 
564 
1,541 
1,020 
2,030 


1,078 

1,151 

2,348 

4,009 

2,366 

3,345 

383 

453 

2,366 

5,122 

1,644 

1,852 

1,940 

2,078 

^  Interviews  were  attempted  with  all  trainees  and  trainee  controls  assigned  by  May 

31,  1984. 

Records  data  collection  was  attempted  for  all  trainees  and  trainee  controls 
assigned  by  June  29,  1985. 

*"  Followup  interviews  were  attempted  with  all  clients  and  client  controls  at  6  and 
12  months  after  assignment,  until  either  at  least  2,300  interviews  had  been 
completed  in  a  state  or  until  October  29,  1985,  whichever  came  first. 

Medicare  records  data  collection  was  attempted  for  all  clients  and  client  controls 
assigned  by  May  31,  1985.   Medicaid  records  data  collection  was  attempted  for  all 
clients  and  client  controls  assigned  by  dates  ranging  from  February  22,  1985  to 
May  31,  1985,  depending  on  the  state.   Medicaid  data  were  not  collected  in  New 
York  because  of  the  small  sample  size  in  that  state. 
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II.   EFFECTS  ON  CLIENTS 

The  expected  effects  of  the  demonstration,  the  process  by  which  they 
were  expected  to  occur,  and  the  role  of  some  additional  mediating  variables 
are  shown  in  Figure  II. 1.   The  various  expected  outcomes  are  naturally  inter- 
connected.  Demonstration  services  were  expected  to  increase  total  home  health 
care  available  to  clients.   They  were  expected  to  reduce  the  amounts  of  other 
formal  in-home  services  and  informal  care  that  the  clients  would  otherwise 
have  received,   but  not  by  enough  to  offset  the  additional  in-home  care 
provided  by  the  demonstration. 

Other  things  equal,  receipt  of  more  home  health  care,  either  formal 
or  informal,  was  expected  to  help  reduce  both  time  spent  in  hospitals  and  time 
spent  in  nursing  homes.   The  expectation  was  that  hospital  stays  could  be 
shortened  by  the  provision  of  home  health  care  because  clients  could  recuper- 
ate at  home;  and  that  nursing  home  stays  could  be  prevented  or  postponed  if 
more  home  health  care  were  available.   As  shown  in  the  table,  longevity  and 
health  and  functional  ability  were  both  expected  to  be  beneficially  affected 
by  the  demonstration.   This  is  because  the  better  care  that  clients  were 

expected  to  receive  was  expected  to  help  them  stay  healthier  and,  thus,  to 

2 
improve  functioning.    Expected  demonstration  effects  on  use  of  other  medical 

services  (i.e.,  visits  with  doctors,  nurses,  and  medical  therapists)  are  not 

clear  a  priori.   If  service  clients  spent  more  time  in  the  community  as  a 

result  of  the  demonstration  or  if  demonstration  aides  themselves  encouraged 

such  visits,  then  an  increase  could  be  anticipated.   At  the  same  time,  some 

visits  with  health  professionals  could  be  rendered  unnecessary  by  the 

preventive  health  maintenance  and  monitoring  of  safety  conditions  performed  by 

the  home  health  aides. 


At  the  time  care  plans  were  developed  with  service  clients, 
agreements  were  reached  with  members  of  the  client's  informal  support  network 
to  continue  to  provide  care. 

2 
The  expected  reduction  in  institutionalization  was  not  necessarily 

expected  to  improve  functioning.   On  the  one  hand,  clients  who  could  function 

in  the  community  given  the  proper  support  networks  might  lose  functional 

abilities  and  even  die  upon  being  admitted  to  a  nursing  home.   But  on  the 

other  hand,  some  clients  might  improve  in  nursing  homes  because  they  got 

attention  and  services  they  did  not  get  at  home. 
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Medicare  and  Medicaid  reimbursements  were  expected  to  be  affected  by 
the  demonstration  through  several  mechanisms.   Reimbursements  for  home  health 
care  were  expected  to  be  reduced  because  of  substitution  of  demonstration 
services  for  other  formal  services  that  would  have  been  covered  at  least  in 
part  by  Medicare  and  Medicaid.   Reimbursements  for  hospital  care  (mostly 
Medicare)  and  for  nursing  home  care  (mostly  Medicaid)  were  expected  to  be 
reduced  if  clients  spent  less  time  in  these  institutions.   The  effect  on  other 
reimbursements  is  not  clear  a  priori,  but  in  any  case  was  not  expected  to 
increase  enough  to  outweigh  the  expected  effects  of  reduced  hospital  and 
nursing  home  use. 

The  sections  that  follow  summarize  the  findings  of  the  evaluation 
with  respect  to  each  of  these  outcomes:   utilization  of  formal  in-home 
services,  receipt  of  informal  care,  substitution  of  formal  services  for 
informal  care,  longevity,  hospital  care,  nursing  home  care,  use  of  other 
medical  services,  Medicaid  and  Medicare  reimbursements,  and  health  status  and 
physical  functioning. 

Formal  In-Home  Services 

The  demonstration  was  expected  to  affect  client  outcomes  by 
increasing  the  total  amount  of  in-home  care  received  by  service  clients.   It 
is  important,  therefore,  to  measure  the  extent  to  which  this  increase 
occurred.   In  this  regard,  and  throughout  our  analyses,  it  is  important  to 
remember  that  the  demonstration  projects  were  implemented  in  environments 
where  other  formal  in-home  services  were  available.   It  is  also  true  that  not 
all  clients  assigned  to  the  treatment  group  received  demonstration  services. 
Thus,  the  demonstration  effect  on  formal  in-home  care  is  appropriately 
measured  as  the  difference  between  the  average  amount  of  formal  in-home 
services  received  by  all  service  clients  (from  demonstration  and 
nondemonstration  sources)  and  those  received  by  client  controls,  whose 


All  of  the  estimated  effects  presented  in  this  chapter  are  measured 
per  client  served  by  the  demonstration,  rather  than  per  client  assigned  to  the 
service  group.  We  thus  attribute  all  demonstration  effects  to  those  clients 
who  actually  received  demonstration  services,  on  the  assumption  that  the 
demonstration  had  no  effect  on  clients  assigned  to  the  service  group  who 
received  no  demonstration  services. 
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experience  represents  the  outcomes  that  service  clients  could  have  expected  in 
the  absence  of  the  demonstration. 

The  amount  of  formal  in-home  services  received  by  a  client  ^r  group 
of  clients  can  be  thought  of  as  consisting  of  three  factors:  whether  any 
services  were  provided;  if  so,  for  what  duration  of  time,  and  with  what 
intensity  during  the  period  they  were  provided.   The  demonstration  could  be 
expected  to  affect  each  of  these  factors  in  different  ways.   The  proportion  of 
clients  receiving  any  formal  in-home  services  increased  substantially  and 
significantly  in  all  seven  demonstration  states,  with  the  increase  ranging 
from  25  percentage  points  (in  Ohio)  to  61  percentage  points  (in  Arkansas). 
Although  the  demonstration  did  not  take  a  population  that  would  have  received 
no  services  and  provide  some  services  to  all  of  them,  it  certainly  increased 
markedly  the  probability  of  receiving  formal  services. 

Smaller,  but  still  significant,  increases  were  found  in  all  states 
in  the  duration  of  formal  in-home  services  among  those  clients  who  received 
them.   The  increases  ranged  from  9  percent  of  the  followup  period  (New  York) 
to  30  percent  of  the  followup  period  (Arkansas).   The  intensity  of  formal  in- 
home  services  during  the  months  in  which  they  were  received  also  increased 
significantly  in  all  states,  by  amounts  ranging  from  2  hours  per  week  (Ohio) 
to  11  hours  per  week  (Arkansas). 

The  overall  average  rate  of  formal  care  captures  the  effects  of  all 
these  factors.   The  rate  of  formal  care  is  the  average  number  of  hours  of 
service  per  week,  across  all  clients  (including  clients  who  received  no 
services)  and  all  weeks  (including  weeks  when  no  service  was  received).   As 
shown  in  the  first  column  of  Table  II.  1,  the  average  rate  of  formal  care  among 
client  controls  ranged  from  less  than  1  hour  per  week  in  Arkansas  to  nearly 
4  hours  per  week  in  New  York.   Demonstration  effects  on  this  rate  (second 
column)  were  statistically  significant  in  every  state,  ranging  from  1.20  hours 
per  week  in  Kentucky  to  8.29  hours  per  week  in  South  Carolina.   Although  these 
effects  are  large  relative  to  the  amount  of  care  received  by  client  controls, 
in  no  state  do  they  represent  an  extremely  intensive  treatment. 

Informal  Care 

Informal  care  is  the  care  provided  by  household  members,  relatives, 
and  friends.   The  estimated  differences  in  the  proportions  of  service  clients 
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and  controls  receiving  informal  care  from  members  of  the  client's  household 
were  small — all  within  plus  or  minus  a  few  percentage  points — and  none  was 
statistically  significant. 

There  were  significant  demonstration  effects  on  informal  care  from 
nonhousehold  sources,  however.   Service  clients  in  five  states — Arkansas, 
Kentucky,  Ohio,  South  Carolina,  and  Texas — were  significantly  less  likely  than 
client  controls  in  those  states  to  receive  such  care,  by  amounts  ranging  from 
4  to  10  percentage  points.   Furthermore,  among  those  who  were  receiving 
informal  care  from  friends  and  relatives  outside  the  household  at  the  time  of 
the  followup  interview,  service  clients  received  significantly  fewer  hours  of 
care  per  week  than  client  controls  in  all  states  but  New  York.   As  shown  in 
column  (3)  of  Table  II.  1,  the  average  rate  of  informal  services  from 
nonhousehold  sources  ranged  among  client  controls  from  around  4  hours  per  week 
in  Arkansas,  New  York,  Ohio,  and  Texas,  to  about  5  hours  in  Kentucky  and  New 
Jersey,  to  nearly  8  hours  per  week  in  South  Carolina. 

Clients  who  received  demonstration  services  received  significantly 
less  informal  care  than  client  controls  in  Ohio  and  South  Carolina,  a 
difference  of  nearly  two-thirds  of  an  hour  per  week  in  Ohio  and  1.42  hours  per 
week  in  South  Carolina,  as  shown  in  column  (4).   The  service-control 
differences  in  the  average  rate  of  informal  care  in  the  other  demonstration 
states  were  not  statistically  significant. 

Augmentation  versus  Substitution 

The  effects  of  the  demonstrations  in  increasing  formal  care  to 
clients  were  larger  than  the  effects  in  decreasing  informal  care.   As  seen  in 
column  (6)  of  Table  II. 1,  in  six  of  the  seven  states  there  were  statistically 
significant  increases  in  total  (formal  plus  informal)  in-home  care  from 
nonhousehold  sources.   The  extent  to  which  reductions  in  informal  care  offset 
the  increases  in  formal  care  is  measured  by  the  degree  of  substitution — that 
is,  the  percentage  of  the  increase  in  formal  care  that  substituted  for  lost 
informal  care  rather  than  augmenting  the  total  hours  of  care  received.   The 
degree  of  substitution,  as  shown  in  the  final  column  of  Table  II.  1,  ranged 
from  zero  in  New  York  and  Texas  to  31  percent  in  Ohio  and  40  percent  in 
Kentucky.   In  New  Jersey,  6  percent  of  formal  care  substituted  for  informal 
care,  and  in  Arkansas  and  South  Carolina,  15  percent. 
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Thus,  most  or  all  o£  the  increase  in  formal  care  associated  with  being  in  the 
service  group  translated  into  an  increase  in  total  in-home  care. 

Survival 

Between  14  and  19  percent  of  the  client  controls  in  each  state  died 
during  the  12-month  period  after  initial  assessment  over  which  client  outcomes 
were  measured.   As  shown  in  Table  II. 2,  on  average  client  controls  survived 
approximately  90  percent  of  the  followup  period.   There  were  no  significant 
demonstration  effects  on  the  fraction  of  the  followup  period  survived. 

Hospital  Care 

Although  it  was  not  anticipated  that  demonstration  services  could 
prevent  hospital  admissions,  it  was  expected  that  they  could  reduce  average 
length  of  stay  by  enabling  service  clients  to  be  discharged  more  quickly  to 
recuperate  at  home.   No  significant  service-control  differences  were  found  in 
the  proportion  of  clients  hospitalized,  in  the  mean  number  of  hospital 
admissions,  or  in  the  average  length  of  hospital  stay. 

Client  controls  in  the  various  states  spent  on  average  between  3  and 
5  percent  of  the  followup  period  in  the  hospital,  as  can  be  seen  in  the  third 
column  of  Table  II. 2.   The  only  significant  demonstration  effect  on  time  spent 
in  the  hospital  over  the  entire  12-month  followup  period  was  an  increase  of 
4.5  percentage  points  in  New  York.   For  the  first  six  months  after  assessment, 
there  was  a  significant  reduction  of  1.0  percentage  point  in  the  proportion  of 
time  spent  in  hospitals  in  New  Jersey  (i.e.,  about  two  days  over  a  six-month 
period) . 

Nursing  Home  Care 

As  noted,  a  primary  goal  of  the  client  component  of  the  demon- 
stration was  to  prevent  or  delay  nursing  home  admissions.   This  goal  was  not 
achieved.   Only  8  to  16  percent  of  client  controls  in  the  demonstration  states 
were  admitted  to  nursing  homes  during  the  followup  period,  and  the  average 
fraction  of  the  followup  period  spent  in  nursing  homes  by  client  controls  was 
only  4  to  5  percent  (see  Table  II. 2,  fifth  column).   Thus,  there  was  little 
scope  for  significant  reductions  in  institutionalization.   In  fact,  there  were 
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no  significant  impacts  of  the  demonstration  on  either  the  proportion  of 
clients  institutionalized  or  the  fraction  of  the  followup  period  spent  in 
nursing  homes.   Even  when  the  resuLis  for  the  first  six  months  of  the  foLLowup 
period  were  examined  separately,  no  Large  or  significant  treatment  effects 
appeared. 

We  also  analyzed  whether  the  demonstration  might  have  had  an  effect 
for  certain  subgroups  of  the  population  who  were  more  likely  to  be  admitted  to 
nursing  homes.   Six  groups  at  relatively  high  risk  of  institutionalization 
were  identified:  the  very  old  (80  years  of  age  or  older),  the  mentally  or 
physically  impaired,  the  very  old  who  lived  alone,  the  very  old  who  were 
mentally  or  physically  impaired,  the  very  old  who  lived  alone  and  were 
impaired,  and  clients  who  had  spent  time  in  a  nursing  home  within  the  six 
months  preceding  the  initial  assessment. 

These  subgroups  did  indeed  tend  to  have  higher  rates  of  insti- 
tutionalization than  the  demonstration  population  as  a  whole.   The 
demonstration  did  not  succeed,  however,  in  significantly  reducing  the 
likelihood  of  nursing  home  admissions  in  these  subgroups  with  the  exception  of 
the  very  old,  and  the  very  old  and  impaired,  in  the  state  of  New  York — a 
finding  that  was  based  on  only  15  institutionalizations.   Among  clients  who 
were  very  old  and  living  alone — between  13  and  17  percent  of  the  client 
population  depending  on  the  state — the  demonstration  did  have  consistently 
negative  estimated  effects  on  the  proportion  admitted  to  nursing  homes. 
Although  the  treatment-control  differences  were  not  statistically  significant 
in  any  state,  the  consistency  of  direction  of  the  estimated  effects  suggests 
that  there  might  have  been  an  effect,  but  that  the  sample  sizes  for  this 
subgroup  were  too  small  for  it  to  be  detected  with  confidence. 

Other  Medical  Services 

Impacts  of  the  demonstration  on  clients'  utilization  of  professional 
health  care — i.e.,  the  services  of  doctors,  nurses,  or  other  licensed  health 
professionals — were  quite  minor.   The  only  statistically  significant  effect  on 
number  of  visits  in  any  of  these  categories  in  any  state  was  a  greater  number 
of  service  clients  than  client  controls  in  Kentucky  seeing  a  licensed  health 
professional  other  than  doctor  or  nurse  in  their  home  in  the  two  months 
preceding  the  followup  interview. 
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Medicare  and  Medicaid  Reimbursements 

As  shown  in  Table  II. 3,  average  total  Medicare  reimbursements  for 
client  controls  ranged  from  about  S600  per  cLLenc  per  quarter  in  Kentucky  to 
about  $1,600  per  client  per  quarter  in  New  Jersey.   In  every  state,  the  great 
bulk,  of  Medicare  reimbursement  was  for  hospital  costs.   Average  Medicaid 
reimbursements  for  client  controls  were  much  smaller,  ranging  from  around 
$80  in  Arkansas  to  around  $250  in  Kentucky,  New  Jersey,  Ohio,  and  South 
Carolina.    In  Arkansas,  New  Jersey,  and  South  Carolina,  these  reimbursements 

were  mostly  for  nursing  home  care.   Hospital  care  was  the  most  important 

2 
Medicaid  cost  category  m  Kentucky,  Ohio,  and  Texas. 

Given  the  almost  negligible  effects  of  the  demonstration  on  time 
spent  in  hospitals  and  nursing  homes,  major  reductions  in  Medicare  and 
Medicaid  reimbursements  are  unlikely  to  have  occurred.   By  and  large  they  did 
not,  as  Table  II. 3  shows.   There  were,  however,  several  effects  of  note: 

•  In  New  Jersey,  Medicare  reimbursements  were  sig- 
nificantly reduced,  by  $240  per  client  served  per 
quarter.   This  effect  showed  a  significant  tendency 
to  decline  with  time  since  random  assignment,  and 
three-quarters  of  it  was  due  to  a  statistically 
significant  decrease  in  hospital  reimbursements. 
This  corroborates  the  finding  of  a  significant 
reduction  in  time  spent  in  hospitals  during  the 
first  six  months  after  assignment  in  New  Jersey. 

•  Significant  reductions  in  Medicaid  reimbursements 
were  found  for  both  Arkansas  ($40  per  client  served 
per  quarter)  and  South  Carolina  ($59  per  client 
served  per  quarter).   In  the  case  of  Arkansas,  there 
was  a  significant  tendency  for  the  Medicaid  savings 
to  increase  over  time  since  random  assignment,  and 
the  savings  can  be  attributed  almost  entirely  to 
reductions  in  nursing  home  costs. 

•  In  every  state  except  Kentucky,  there  were 
statistically  significant  savings  on  home  health 
care  in  the  Medicare  program,  the  Medicaid  program, 
or  both.   This  shows  that  the  demonstration  was 


Medicaid  data  were  not  collected  in  New  York  because  of  the  small 
client  sample  available  for  analysis. 

The  cost  categories  shown  do  not  sum  to  the  totals  because  'of  the 
existence  of  a  residual  category  which  includes  outpatient  care,  prescription 
drugs,  and  other  miscellaneous  services. 
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Table  II. 3.   Medicare  and  Medicaid  Reimbursements 
(per  client  served  per  quarter) 


M 

2di care 

Me 

-dicaid 

Control 

Demonstrat  ion 

Control 

Demonstration 

Mean 

Effect 

Mean 

Effect 

Arkansas 

Total 

S1095 

-S39 

$31 

-SAO------- 

Hospital 

728 

51 

8 

1 

Nursing  home 

16 

-10 

54 

-35-,v-;.- 

Home  health 

126 

-75.VV- 

5 

-3 

Kentucky 

' 

Total 

624 

32 

252 

1 

Hospital 

453 

27 

90 

-8 

Nursing  home 

12 

0 

35 

-2 

Home  health 

62 

-6 

83 

8 

New  Jersey- 

Total 

1599 

-2^Q<-!c-k 

253 

-30 

Hospital 

1218 

-179^'^- 

59 

-17 

Nursing  home 

19 

-4 

118 

-6 

Home  health 

140 

-30**^!.' 

27 

-13** 

New  York 

Total 

1038 

-30 

a 

a 

Hospital 

667 

103 

Nursing  home 

10 

-11 

Home  health 

170 

-107* 

Ohio 

Total 

888 

-66 

245 

13 

Hospital 

670 

-60 

93 

-14 

Nursing  home 

15 

-4 

81 

26* 

Home  health 

62 

-9* 

8 

-1 

South  Carolina 

Total 

761 

25 

251 

-59*t!.- 

Hospital 

489 

43 

57 

-1 

Nursing  home 

15 

-1 

95 

-35 

Home  health 

182 

-54*^ 

35 

-21-!!.-A-A- 

Texas 

Total 

1064 

26 

99 

0 

Hospital 

762 

52 

38 

8 

Nursing  home 

9 

-4 

21 

0 

Home  health 

128 

-18 

20 

-12*** 

SOURCE:   Burstein 

and  Branagan 

,  Client  Medicare 

and  Medicaid 

Reimbursements 

(1987),  Tables  3.4,  3.5,  and  4.1-4.6,  with  adjustments  for  clients 
who  received  no  services. 


Medicaid  data  not  collected  in  New  York. 

***  Statistically  significant  at  the  1  percent  level. 

**  Statistically  significant  at  the  5  percent  level. 

*  Statistically  significant  at  the  10  percent  level 
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paying  for  services  that  would  otherwise  have  been  paid  for  at  least  in  part 
by  the  Medicare  and  Medicaid  prograns. 

Although  these  findings  teLi  a  coherent  story,  the  effects  are  not 
very  large.   In  order  for  the  client  component  of  the  demonstration  to  have 
saved  money  from  the  taxpayers'  point  of  view,  Medicare  and  Medicaid  savings 
would  have  had  to  be  greater  than  the  cost  of  demonstration  services. 
However,  combined  Medicare  and  Medicaid  costs  net  of  home  health  care 
reimbursements  were  reduced  only  in  Arkansas,  New  Jersey,  and  Ohio;  and  the 
greatest  reduction — in  New  Jersey — was  less  than  $3.00  per  client  served  per 
day.   If  this  is  less  than  the  daily  cost  of  demonstration  services,  then  the 
client  component  of  the  demonstration  did  not  pay  for  itself  even  in  New 
Jersey.   The  relationship  between  demonstration  costs  and  taxpayer  savings  is 
examined  in  Chapter  IV. 

Health  and  Functioning 

A  sample  of  40  percent  of  the  service  clients  and  20  percent  of  the 
client  controls  who  had  been  assessed  before  July  1984  was  reassessed 
beginning  in  May  1985,  to  determine  demonstration  effects  on  health  and 
physical  functioning.   Sample  sizes  were  too  small  to  provide  reliable  state- 
specific  estimates  of  effects  for  individual  states.   Estimated  effects  are 
therefore  based  on  the  combined  sample  for  the  six  states  that  had  begun 
serving  clients  by  July  1984  (all  except  New  York). 

The  demonstration  had  significant  effects  on  several  measures  of 
unmet  client  needs.   There  were  significant  decreases  among  service  clients 
relative  to  controls  in  the  average  number  of  Activities  of  Daily  Living 
(ADL)  in  which  more  help  was  needed;  in  the  average  number  of  Instrumental 
Activities  of  Daily  Living  (lADL)  in  which  more  help  was  needed;  and  in  the 
proportions  of  clients  experiencing  unmet  need  for  any  medical  appliance,  for 
in-home  medical  equipment,  or  for  skilled  health  services. 

Table  II. 4  shows  the  demonstration  effects  on  a  number  of  final 
outcome  measures  pertaining  to  health  and  functional  abilities.   Clients 
served  by  the  demonstration  were  found  to  be  totally  dependent  in  signif- 
icantly fewer  ADL  and  lADL  than  client  controls  at  the  time  of  reassessment 
(on  average,  about  20  months  after  the  initial  assessment).   For  ADL,  which 
are  measured  on  a  scale  of  0  to  5,  the  difference  was  .1,  about  17  percent  of 
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Table  II. A.   Heal-n  and  Physical  Functioning 

(clients  served,  combined  six-state  sample) 


Activities  of  Daily  Living  (ADL) 

Average  number  in  which  independent 

Average  number  in  which  totally  dependent 

Instrumental  Activities  of  Daily  Living  (lADL)^ 

Average  number  in  which  independent 

Average  number  in  which  totally  dependent 


Cent  rol 

Demonstration 

Mean 

Effect 

3.3 

0.0 

0.6 

-o.^-^ 

5.1 

0.0 

5.3 

-0.5^^^ 

Orientation 

Average  number  correct  (9-question  scale) 

Self-Reported  Health  Status  (percent) 
Better 
Same 
Worse 

Faculties — Percent  with 

Vision  same  or  better  **" 

b  c 
Hearing  same  or  better  * 

Speech  same  or  better  *^ 

Judgment  same  or  better  *^ 

Communication  same  or  better  '^ 


7.4 


0.5* 


22.8 

5 .  7*- 

55.5 

-5.8* 

21.8 

-2.6 

74.3 

1.3 

85.1 

-1.9 

89.5 

3.8* 

83.4 

0.6 

83.5 

5.2* 

Medical  Conditions — Percent 
with  one  or  more  conditions 
Present  at  reassessment 
New  at  reassessment 
Worse  at  reassessment 


Restricted  Activities,  last  two  months 

Days  in  bed 

Days  of  restricted  activity 

Days  of  unrestricted  activity 


98.5 

-0.6 

15.6 

-1.2 

47.0 

-5.1** 

10.7 

0.3 

22.3 

0.0 

29.4 

0.9 

SOURCE:   Orr  and  Visher,  Client  Health  and  Related  Outcomes  (1987),  Table  4.8, 
with  adjustments  for  clients  who  received  no  services. 


Maximum  number  of  ADL  =  5;  maximum  number  of  lADL  =  13. 
Effect  measured  as  difference  in  raw  means. 
'Significance  test  performed  on  distribution  as  a  whole. 


*Statistically  significant  at  the  1  percent  level. 
**Statistically  significant  at  the  5  percent  level. 
*Statistically  significant  at  the  10  percent  level. 
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the  control  group  mean.   For  lADL,  which  are  measured  on  a  scale  of  0  to  13, 
the  difference  was  .5,  about  9  percent  of  the  control  group  mean.   This 
suggests  that  demonstration  ser-.'ices  may  have  encouraged  clients  to  help  with 
ADL  functions  that  would  otherwise  have  been  performed  entirely  by  others,  and 
to  help  with  lADL  functions  that  would  otherwise  have  been  performed  entirely 
by  others  or  not  performed  at  all.   Since  the  demonstration  had  no  effect  on 
the  numbers  of  ADL  or  lADL  in  which  clients  were  totally  independent, 
demonstration  services  did  not  enable  partially  dependent  clients  to  dispense 
with  assistance. 

Service  clients  were  also  significantly  better  oriented  than  client 
controls  at  reassessment,  based  on  a  set  of  9  questions  administered  to 
them.   Clients  who  received  demonstration  services  averaged  .5  more  correct 
answers  than  client  controls,  an  improvement  of  about  7  percent  over  the 
control  group  mean. 

Self-reported  health  status  was  measured  on  a  four-point  scale: 
excellent,  good,  fair,  and  poor.   Clients  served  by  the  demonstration  were 
significantly  more  likely  than  client  controls  to  rate  their  own  health  higher 
at  reassessment  than  they  had  at  initial  assessment.   The  difference  was 
5.7  percentage  points.   This  outcome  measure  almost  certainly  captures 
psychological  as  well  as  physical  well-being. 

Finally,  demonstration  service  clients  were  significantly  less 
likely  than  client  controls  to  have  deteriorated  in  speech  and  communication 
between  initial  assessment  and  reassessment,  but  no  less  likely  to  have 
deteriorated  in  other  faculties  (vision,  hearing,  and  judgment);  they  were 
significantly  less  likely  than  client  controls  to  report  that  a  specific 
medical  condition  had  worsened  in  the  12  months  prior  to  reassessment;  and 
there  were  no  significant  differences  between  the  two  groups  in  restriction  of 
activities  in  the  two  months  preceding  reassessment. 

Summary  of  Effects  on  Clients 

The  demonstration  succeeded  in  providing  services  to  many  clients 
who  otherwise  would  not  have  received  them.   The  additional  formal  in-home 
services  provided  by  demonstration  aides,  however,  did  not  .reduce  institu- 
tionalization.  The  proportion  of  client  controls  who  were  admitted  to  nursing 
homes  during  the  followup  period  was  in  no  state  higher  than  16  percent.   It 
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is  therefore  not  surprising  that  the  demonstration  had  virtually  no  effects  on 
time  spent  in  nursing  homes,  or  on  survival,  or  on  time  spent  in  hospitals. 

Analysis  of  Medicare  and  Medicaid  data  corroborates  these 
findings.   The  only  significant  reduction  in  Medicare  reimbursements  was  found 
for  New  Jersey,  attributable  to  reduced  hospital  rather  than  nursing  home 
costs;  this  effect  declined  over  time.   Arkansas  and  South  Carolina 
experienced  Medicaid  cost  reductions  that  were  statistically  significant,  but 
the  amounts  involved  were  small. 

With  respect  to  health  status  and  physical  functioning,  there  were 
several  significant  beneficial  effects.  Relative  to  client  controls, 
demonstration  service  clients  were  less  dependent  in  ADL  and  lADL;  scored 
better  on  orientation;  and  were  more  likely  to  have  rated  their  own  health 
higher,  and  less  likely  to  report  that  a  specific  medical  condition  had 
worsened,  at  reassessment  than  at  initial  assessment.   Service  clients  were 
also  less  likely  than  controls  to  experience  deterioration  in  their  speech  and 
commxinication  ability  between  assessment  and  reassessment. 
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III.   EFFECTS  ON  TRAINEES 


The  expected  effects  of  the  trainee  component  of  the  demonstration, 
and  the  relationships  among  them,  are  sho^..m  in  Figure  Ill.i.   The  subsidized 
employment  provided  by  the  demonstration  was  expected  to  increase  trainees' 
employment  and  earnings  directly.   Participation  in  demonstration  training  and 
employment  was  also  expected  to  increase  the  wage  rates  trainees  could  command 
in  the  regular  labor  market.   Higher  wage  rates  were  expected  to  increase 
earnings  directly,  as  well  as  indirectly  by  increasing  the  trainees'  willing- 
ness to  look  for  work  and  therefore  their  probability  of  finding  unsubsidized 
employment.   Increased  earnings  were  expected,  in  turn,  to  reduce  public 
benefit  receipt  by  trainees  and  to  increase  their  self-esteem  and  psycho- 
logical well-being.   Demonstration  effects  on  each  of  these  outcomes  are 
presented  below.   As  in  the  client  analysis,  demonstration  effects  are 
measured  as  treatment-control  differences. 

Employment  and  Earnings 

Positive  effects  on  employment  and  earnings  of  trainees  were 
expected  through  two  routes — directly  as  a  result  of  participation  in 
subsidized  employment,  and  indirectly  as  a  result  of  increased  success  in 
regular  (nondemonstration)  employment. 

Table  III.l  shows  estimated  effects  on  total  (demonstration  and 
nondemonstration)  monthly  earnings  per  trainee  assigned  and  per  training 
entrant.    The  latter  estimate  is  the  more  appropriate  measure  of  effects  on 
those  who  actually  participated  in  the  demonstration.   In  six  of  the  seven 
states,  the  demonstration  significantly  increased  the  total  monthly  earnings 
of  trainees.   In  these  six  states,  the  size  of  the  earnings  gain  per  training 
entrant  (see  second  column)  ranged  from  a  low  of  $122  per  month  in  Arkansas  to 
a  high  of  $216  per  month  in  New  Jersey.   This  range  represents  between  55  and 


These  numbers  are  the  combined  average  effect  of  the  demonstration 
on  demonstration  and  nondemonstration  earnings  over  the  entire  30-month 
evaluation  followup  period. 
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Table  TII.l.   Effects  on  Total  Monthly  Earnings 

(dol Lars ) 


Per  Trainee  Per  Training 

Ass  igned Entrant 


Arkansas  lll-'.--;,-v,-  122''"'"-'' 

Kentucky  142-Ar.vv.-  lAS-"^-^ 

New  Jersey  ig2--"'--A-  216"""'* 

New  York  36  39 

Ohio  185--=^^"'^  210""" 

South  Carolina  130**^-  140*'-=^* 

Texas  106***  141*** 


SOURCE:   Enns,  Bell,  and  Flanagan,  Trainee  Employment  and  Earnings  (1987), 
Tables  III. 2  and  III. 10. 

***Statistically  significant  at  the   1  percent  level. 

**Statistically  significant  at  the   5  percent  level. 

*Statistically  significant  at  the  10  percent  level. 
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114  percent  of  control  i^roup  average  earnings.   The  earnings  effects  per 
trainee  assigned  were  somewhat  smaller  in  each  state  and  substantially  smaller 
in  Texas  ($106  per  month"),  which  had  the  highest  percentage  of  assigned 
trainees  never  begin  training. 

The  time  pattern  of  the  earnings  effects  is  shown  in  Table  III. 2. 
During  the  months  when  the  typical  training  entrant  was  still  in  training  or 
subsidized  employment  (the  demonstration  period),  the  demonstration  substan- 
tially increased  total  monthly  earnings  (which  include  demonstration  wages)  in 
all  states  except  New  York.   During  postdemonstration  Year  1  (the  first  12 
months  after  the  typical  trainee  left  subsidized  employment  in  each  state)  the 
earnings  effects  in  Arkansas,  Kentucky,  New  Jersey,  Ohio,  and  South  Carolina 
declined.   This  decline  was  not  unexpected  given  that  some  trainees  who  had 
worked  in  subsidized  employment  did  not  find  work  in  unsubsidized  jobs  and 
that  a  higher  proportion  of  controls  found  work  during  the  latter  period. 
Overall,  the  range  of  effects  on  total  monthly  earnings  across  states  narrowed 
considerably  from  the  demonstration  period  (between  $96  per  month  in  Texas  and 
$351  per  month  in  New  Jersey)  to  postdemonstration  Year  1  (between  $63  oer 
month  in  New  York  and  $215  per  month  in  Ohio).   During  postdemonstration  Year 
2  the  effects  on  total  earnings  declined  even  further  in  all  states  except 
Kentucky  and  Texas.   In  New  York  and  South  Carolina,  the  estimated  effects  in 
postdemonstration  Year  2  were  no  longer  statistically  significant.   In  the 
other  five  states,  they  ranged  from  $102  to  $216  per  training  entrant,  or  from 
48  to  104  percent  of  the  control  group  average. 

As  noted,  the  results  just  presented  include  the  trainees*  earnings 
in  demonstration  employment.   The  effects  on  nondemonstration  employment  and 
earnings  are  shown  in  Table  III. 3.   During  postdemonstration  Year  1,  only  two 
states — New  Jersey  and  Ohio — showed  significant  effects  on  the  percent  of 
trainees  employed  in  nondemonstration  jobs  and  the  number  of  hours  worked  per 
month  in  nondemonstration  employment.   In  postdemonstration  Year  2,  these  two 
states  plus  Arkansas  and  Texas  showed  significant  effects  on  the  same  two 


This  term  is  used,  rather  Chan  postdemonstration  employment,  for 
two  reasons.  First,  it  includes  any  nondemonstration  employment  of  trainees 
during  their  training  and  subsidized  employment.  Second,  all  employment  of 
controls  is  by  definition  nondemonstration  employment. 
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Table  III. 2.   Time  Pattern  of  Effects  on  Total  Monthly  Earnings 

(dollars  per  training  entrant) 


Demonstration 
Period 


Postdemonstrat ion 
Year  1 


Post demon St rat  ion 
Year  2 


Arkansas 

l^l'X"X"k 

Kentucky 

172*--^* 

New  Jersey 

351*^-^- 

New  York 

22 

Ohio 

269*** 

South  Carolina 

267*** 

Texas 

96** 

127*** 
117*-;r* 
173*** 

63** 
215*** 

81*** 
109*** 


102*** 
161*** 
126*** 
12 

22 
216*** 


SOURCE:   Enns,  Bell,  and  Flanagan,  Trainee  Employment  and  Earnings 

(1987),  Table  III. 3,  with  adjustments  for  trainees  who  did  not 
enter  training. 

NOTE:   Total  monthly  earnings  of  the  trainee  group  includes  both 

demonstration  and  nondemonstration  earnings.   The  demonstration 
period  is  defined  for  each  state  as  the  number  of  months  from 
assignment  until  the  typical  trainee  left  subsidized 
employment.   Postdemonstration  Year  1  for  each  state  is  the  12 
months  following  the  end  of  the  demonstration  period. 
Postdemonstration  Year  2  is  all  months  in  the  followup  period 
after  Year  1. 

***Statistically  significant  at  the  1  percent  level. 
**Statistically  significant  at  the  5  percent  level. 
*Statistically  significant  at  the  10  percent  level. 
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outcomes.   Significant  effects  on  the  proportion  employed  in  postdemonstration 
Year  2  ranged  from  12  to  28  percentage  point  increases  in  New  Jersey  and 
Texas,  respectively  (29  to  85  percent  increases  over  the  control  group  means 
in  those  states).   Increases  in  hours  worked  over  the  same  period  ranged  from 
22  to  48  hours  per  month  in  New  Jersey  and  Texas,  respectively  (36  to  104 
percent  of  the  control  group  means). 

Effects  on  nondemonstration  earnings  were  significant  in  four  states 
during  postdemonstration  Year  1  and  in  five  states  during  Year  2.   Significant 
effects  in  Year  1  ranged  from  an  increase  of  $26  per  month  in  South  Carolina 
to  $81  per  month  in  New  Jersey;  in  Year  2  they  ranged  from  $101  per  month  in 
Arkansas  and  Ohio  to  $215  per  month  in  Texas.   These  latter  increases 
represent  from  48  to  103  percent  of  the  average  earnings  in  the  control  group. 

Effects  on  the  hourly  wage  rates  of  trainees  in  nondemonstration 
employment  are  shown  in  the  last  two  columns  of  Table  III. 3.    In  Arkansas, 
Kentucky,  and  South  Carolina,  positive  effects  on  wage  rates  occurred 
throughout  the  postdemonstration  period,  ranging  between  32  cents  and  90  cents 
per  hour  (9  to  22  percent  of  the  control  group  means).   In  New  Jersey  and  New 
York,  wage  rates  increased  during  only  part  of  the  followup  period,  and  in 
Ohio  and  Texas  not  at  all.   Wage  gains  were  greatest  in  the  southern  and 
mostly  rural  states  where,  in  general,  wage  rates  are  low  relative  to  the  more 
urban  states. 

In  addition  to  improving  the  employment,  earnings,  and  wage  rates  of 
trainees,  the  demonstration  might  be  expected  to  have  changed  job  search 
activity  and  increased  overall  labor  force  participation.   Substantial  gains 
in  labor  force  participation  did  indeed  occur  while  trainees  were  working  in 
subsidized  employment.   Those  gains  were  short-lived,  however,  as  job  search 
and  labor  force  participation  rates  for  the  trainee  group  returned  to  near  the 
level  of  those  for  the  control  group  during  the  two  postdemonstration  years. 


The  estimated  effects  on  wage  rates  presented  here  have  been 
adjusted  to  take  account  of  differences  in  characteristics  between  the  subsets 
of  trainees  and  controls  who  worked  in  nondemonstration  jobs — the  only  sample 
members  for  whom  wage  rates  can  be  observed. 
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Effects  on  Public  Benefits 

The  effects  of  the  demonstration  on  public  benefits  were  consistent 
with  the  effects  on  total  earnings.   AIL  seven  demonstration  projects  moved  a 
significant  proportion  of  trainees  off  AFDC,  and  all  but  one  reduced  the 
average  benefit  amount  received  from  AFDC.   In  four  of  the  seven  states,  the 
demonstration  also  moved  significant  proportions  of  demonstration  trainees  off 
the  Food  Stamp  Program  and  reduced  the  average  food  stamp  benefit  amount. 
Average  Medicaid  benefits  over  the  evaluation  followup  period  as  a  whole  were 
not  significantly  affected  in  any  of  the  states,  at  least  in  part  because 
Medicaid  eligibility  for  trainees  was  automatically  extended  to  cover  the 
period  of  subsidized  employment. 

Table  III. 4  summarizes  the  effects  of  the  demonstration  on  the 
percentage  of  training  entrants  receiving  benefits  from  the  AFDC  and  Food 
Stamp  Programs,  and  the  two  programs  combined,  in  a  typical  month  during  the 
followup  period.   Benefit  receipt  for  both  programs  combined  was  reduced  by  13 
to  14  percentage  points  in  New  Jersey,  Ohio,  and  South  Carolina  (15  to  16 
percent  of  the  control  group  means).   Benefit  receipt  rates  dropped  most 
sharply  in  the  AFDC  program  (26  to  39  percentage  points  for  the  same  three 
states  and  for  Kentucky,  or  35  to  53  percent  of  the  control  group  means),  and 
less  sharply  for  food  stamps  (3  to  15  percentage  points  for  the  same  four 
states,  or  5  to  19  percent  of  the  control  group  means).   In  Arkansas  and 
Texas,  smaller  effects  on  AFDC  receipt  (13  and  11  percentage  point  reductions, 
respectively)  were  combined  with  no  significant  effect  on  food  stamp 
receipt.   In  New  York,  a  very  small  (3  percentage  point)  reduction  in  the 
proportion  receiving  AFDC  was  just  offset  by  a  slight  (5  percentage  point) 
increase  in  food  stamp  receipt. 

Table  III. 5  presents  the  estimated  effects  of  the  demonstration  on 
the  average  monthly  benefit  amount  received  by  training  entrants  from  the  AFDC 
and  Food  Stamp  Programs,  and  from  the  two  programs  combined.   Here  again.  New 
Jersey,  Ohio,  and  South  Carolina  show  the  largest  benefit  reductions  under 
both  programs  combined — with  savings  ranging  from  $94  to  $110,  or  27  to  40 
percent  of  the  average  benefit  amount  received  by  members  of  the  control 
group.  Arkansas,  Kentucky,  and  Texas  also  achieved  significant  though  smaller 
benefit  reductions  ($26  to  $71)  for  the  two  programs  combined.   Most  of  the 
savings  occurred  in  the  AFDC  program,  where  monthly  benefit  reductions  ranged 
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Table  III. 4.   Effects  on  Percent  ot  Training  Entrants  Receiving  Public  Benefits 

(percentage  points) 


AFDC  and 
AFDC Food  Stamps Food  Stamps 

Arkansas  -I3-A--A--A-  _]_                 -5-;."A"A- 

Kentucky  -28"—  -S—               -g-;.-^-^- 

New  Jersey  -26""'*  -]_]_-a-t;--a-  -I4-A--A--;.- 

New  York  -3^"*  5—*               0 

Ohio^  -27***  -15***  -13*** 

South  Carolina  -39***  -8***  -14*** 

Texas  -H***  -1                -2* 

SOURCE:   Bell,  Trainee  Public  Program  Benefits   (1987),  Table  III. 7. 

^Effects  on  food  stamp  benefits  and  combined  AFDC  and  food  stamp 
benefits  are  for  Butler  and  Hamilton  counties  only;  computerized 
food  stamp  data  were  not  available  for  other  demonstration  counties  in  Ohio. 

***Statistically  significant  at  the   1  percent  level. 

**Statistically  significant  at  the  5  percent  level. 

*Statistically  significant  at  the  10  percent  level. 
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Table  III. 5.   Effects  on  Monthly  Benefit  Amount 
(dollars  per  training  entrant) 


Arkansas 

Kentucky 

New  Jersey 

New  York 

Ohio^ 

South  Carolina 

Texas 


AFDC  and 

AFDC 

Food  Stamps 

Food  Stamps 

-31.VV.Vr 

-16*** 

-47Vr-.V 

-52*** 

-n^^vr 

-yiVrVrVr 

-106*** 

12*** 

-94V.V.Vr 

-2 

6*** 

4 

-84*** 

-28*** 

-101*** 

-68*** 

-42*** 

-110*** 

-18*** 

-8*** 

-26*** 

SOURCE:   Bell,  Trainee  Public  Program  Benefits  (1987),  Table  III. 6. 

^Effects  on  food  stamp  benefits  and  combined  AFDC  and  food  stamp  benefits 
are  for  Butler  and  Hamilton  counties  only;  computerized  food  stamp  data  were 
not  available  for  other  demonstration  counties  in  Ohio. 

***Statistically  significant  at  the   1  percent  level. 

**Statistically  significant  at  the  5  percent  level. 

*Statistically  significant  at  the  10  percent  level. 
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from  $18  to  $106  across  the  six  states  (19  to  54  percent  of  the  control  group 
means).   Food  stamp  savings  were  much  smaller,  ranging  from  $8  to  $42  (6  to  28 
percent  of  the  control  group  means).   In  New  Jersey  and  New  York  there  were 
very  small,  though  statistically  significant,  increases  in  food  stamp 
benefits. 

Table  III. 6  shows  the  timepath  of  effects  on  the  combined  AFDC  and 
food  stamp  monthly  benefit  amount  received  by  the  typical  training  entrant. 
Average  monthly  benefits  were  significantly  reduced  during  the  demonstration 
period  in  all  states  except  New  York,  by  amounts  ranging  from  $20  to  $170  per 
training  entrant  (7  to  39  percent  of  the  control  group  means).   In  five  of  the 
six  states,  benefit  reductions  in  postdemonstration  Year  1  were  larger  than 
during  the  demonstration  period..  There  are  three  reasons  why  there  were 
greater  reductions  in  the  later  period.   First,  the  demonstration  period 
included  the  training  phase  and  time  spent  waiting  for  training  or  subsidized 
employment  to  begin,  when  demonstration  wages  were  intermittent  or  not  paid  at 
all.   Second,  even  once  trainees  began  receiving  wages,  benefits  were  adjusted 
with  a  one-  to  two-month  lag.   Third,  the  AFDC  and  food  stamp  benefit  formulas 
reduced  benefits  less  in  the  first  four  months  of  earnings  than  thereafter. 
For  four  of  the  seven  states,  significant  benefit  reductions  of  $38  to  $95  per 
month  continued  into  postdemonstration  Year  2.   These  reductions  amounted  to  savings 
of  25  to  37  percent  of  the  average  benefits  received  by  trainee  controls. 

The  month-by-month  pattern  of  combined  AFDC  and  food  stamp  benefits 
(not  shown)  is  relatively  consistent  across  states:  a  sharp  drop  in  trainee 
benefits  during  the  demonstration  period  followed  by  a  much  more  gradual 
decline  once  the  trainees  had  left  the  demonstration.   Control  benefits 
declined  gradually  throughout  the  followup  period.   Control  group  benefits 
eventually  dropped  to  the  level  of  trainee  benefits  in  three  states  (New 
Jersey,  New  York,  and  Texas);  but  in  the  other  four  states  long-  term  effects 
continued  until  the  end  of  the  followup  period,  a  full  30  months  after 
assignment. 

The  month-by-month  pattern  of  outcomes  also  sheds  some  light  on  the 
general  absence  of  demonstration  effects  on  both  public  benefits  and  employ- 
ment outcomes  in  New  York.   In  that  state,  the  earnings  of  control  group 
members  rose,  and  their  welfare  dependence  fell,  more  rapidly  than  in  most 
other  states.   This  may  reflect  better  employment  opportunities  for  low-wage 


43 


Table  111.6. 


Time  Path  of  Effects  on  Combined  AFDC  and 
Food  Stamp  Monthly  Benefit  Amount 
(dollars  per  training  entrant) 


Demons t rat  ion 
Period 


Post demon St  rat  ion    Postdemonstration 
Year  1  Year  2 


Arkansas 

-ZO-:^-;^-!' 

Kentucky 

-89"  — 

New  Jersey 

-i70'X";<i.- 

New  York 

38'-"-"-- 

Ohio  (AFDC 

onLy)^ 

-90-A-^V-A- 

South  Carol 

ina 

-IQl'X-ic'X- 

Texas 

-26*--^^- 

■118—* 
-18 
-95Vf&-it 

-134*** 


■53*^^* 

4 
10 

-95*** 
1 


SOURCE:   Bell,  Trainee  Public  Program  Benefits  (1987),  Table  IV. 2,  with 
adjustments  for  trainees  who  did  not  enter  training. 

NOTE:   The  demonstration  period  is  defined  for  each  state  as  the  number  of 
months  from  assignment  until  the  typical  trainee  left  subsidized 
employment.   Postdemonstration  Year  1  for  each  state  is  the  12  months 
following  the  end  of  the  demonstration  period.   Postdemonstration 
Year  2  is  all  months  in  the  followup  period  after  Year  1. 

^Computerized  food  stamp  data  were  only  available  in  two  counties  in  Ohio. 

***Statistically  significant  at  the   17  percent  level. 
**Statistically  significant  at  the   5  percent  level. 
*Statistically  significant  at  the  10  percent  level. 
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workers  in  general  or  more  abundant  employment  services  for  AFDC  recipients  in 
particular.   In  any  case,  even  though  the  earnings  of  the  trainees  who 
participated  in  the  demonstration  increased  markedly  over  time,  and  their 
dependence  on  welfare  declined  correspondingly,  they  fared  little  better  than 
they  would  have  in  the  absence  of  the  demonstration,  as  evidenced  by  the 
control  group  experience. 

Psychological  Well-being 

By  increasing  trainees'  self-sufficiency  and  reducing  their 
dependence  on  welfare,  the  demonstration  was  expected  to  improve  trainees' 
psychological  well-being.   The  evaluation  measured  effects  on  three  aspects  of 
psychological  well-being:  self-esteem,  efficacy/fate  control,  and  life  satis- 
faction.  In  only  one  state  (Ohio)  were  there  significant  effects  on  trainee 
self-esteem,  and  in  only  one  (South  Carolina)  was  there  a  significant  effect 
on  efficacy/fate  control.   These  effects  were  in  the  expected  (beneficial) 
direction,  but  were  quite  small.   Significant  demonstration  effects  on  overall 
satisfaction  with  life  were  more  pervasive  and  somewhat  larger.   In  four 
states  (New  Jersey,  Ohio,  South  Carolina,  and  Texas)  the  proportion  of 
trainees  who  responded  that  they  had  gotten  mostly  what  they  had  hoped  for  out 
of  life  was  8  to  12  percentage  points  larger  than  among  controls.   There  were 
no  significant  effects  on  any  of  these  three  measures  in  Arkansas,  Kentucky, 
or  New  York. 

2 
Trainee  Applicant  Characteristics,  Selection,  and  Performance 

It  is  clear  from  the  results  presented  here  that,  in  most  states, 
the  trainee  component  of  the  demonstration  was  successful  in  increasing  the 
employment  and  earnings  of  participants  and  in  reducing  their  dependence  on 
welfare.  This  success  suggests  several  interesting  questions  regarding  the 
relationship  between  the  trainee  selection  process  and  the  performance  of 
trainees  during  and  after  the  demonstration.   During  the  selection  process, 
was  there  a  systematic  relationship  between  applicant  characteristics  and 
their  perceived  potential  as  homemaker-home  health  aides — and  therefore  their 
selection  as  trainees?  Did  intake  workers  select  the  applicants  who  would 


These  results  are  presented  in  Orr,  Benefits  and  Costs  (1987). 

This  discussion  is  based  on  Bell  and  Reesman,  Trainee  Potential  and 
Performance  (1987). 
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perform  best  or  benefit  most  from  the  demonstration  experience?   And,  with  the 
benefit  of  hindsight,  was  there  a  set  of  identifiable  characteristics  that 
could  have  been  used  to  bptcer  predict  trainee  success?   The  evaluation  was 
able  to  shed  some  light  on  ail  ^^nese  questions. 

With  respect  to  the  relationship  between  applicant  characteristics 
and  their  perceived  potential  as  aides,  it  is  clear  that  in  every  state 
unmeasured  factors  (such  as  perceived  motivation)  weighed  more  heavily  in 
intake  workers'  assessments  than  did  easily  measured  factors.   Typically,  less 
than  15  percent  of  the  variation  among  trainees  in  intake  worker  ratings  of 
applicants*  potential  can  be  explained  by  a  set  of  measured  baseline 
characteristics  that  includes  demographic  characteristics  and  prior  caregiving 
and  work  experience. 

Among  the  baseline  characteristics  examined,  education  had  the  most 
consistent  influence  on  intake  worker  ratings  of  potential  and  the  probability 
of  participating  in  the  demonstrations,  with  significant  and  often  large 
positive  effects  in  five  states.   Employment  and  caregiving  experience 
measures,  taken  as  a  group,  also  had  significant  effects  on  the  probability  of 
participation  in  most  states,  although  the  effects  of  individual  employment 
and  caregiving  variables  were  less  significant  and  somewhat  inconsistent 
across  states. 

To  determine  which  factors  contributed  most  to  success  within  the 
demonstrations,  we  analyzed  the  predictive  power  of  measured  characteristics 
and  intake  worker  ratings  of  applicants*  potential  in  explaining  inprogram 
performance.   All  factors  taken  together  explained  a  relatively  small  fraction 
of  the  variation  in  instructors*  and  supervisors*  performance  ratings  of 
trainees  during  classroom  training,  practicum,  and  subsidized  employment  in 
every  state.   Intake  workers*  potential  ratings  alone  were  best  able  to 
predict  classroom  performance  (although  they  still  explained  less  than 
6  percent  of  the  total  variation  in  performance  among  trainees),  but  had 
virtually  no  value  as  predictors  of  performance  in  subsidized  employment. 
Measured  baseline  characteristics  accounted  for  a  good  deal  more  of  the  total 
variation  in  performance  in  subsidized  employment,  but  rarely  raised  the 
percent  of  variation  explained  above  15  percent  in  any  state. 

The  usefulness  of  measured  baseline  characteristics  and  trainee 
potential  ratings  for  predicting  trainee  earnings  and  public  benefits,  and  the 
impact  of  the  demonstrations  on  those  outcomes,  was  also  examined.   Potential 
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ratings  alone  accounted  for  1  to  10  percent  of  the  variation  in  earnings  and 
public  benefits  outcomes  within  each  state's  trainee  and  control  groups. 
Applicants  with  higher  potential  ratings  had  consistently  higher  earnings  and 
lower  AFDC  and  food  stamp  benefits,  whether  or  not  they  were  members  of  the 
treatment  group.   However,  they  did  not  benefit  more  from  the  demonstration 
than  trainees  with  lower  potential  ratings.   Evidently,  the  demonstration  did 
not  systematically  select  applicants  with  the  greatest  potential  to  benefit 
from  the  demonstration  experience. 

With  the  exception  of  prior  education  (which  had  a  consistently 
positive  influence),  intake  workers  were  unable  to  identify  reliable 
indicators  of  future  success.   This  was  due  in  no  small  part  to  the  fact  that 
even  with  the  benefit  of  hindsight,  measured  characteristics  at  intake 
provided  little  useful  information  which  would  have  reliably  predicted 
success. 

Summary  of  Effects  on  Trainees 

The  demonstrations  substantially  increased  total  monthly  earnings 
during  the  period  when  the  typical  training  entrant  was  still  in  training  or 
subsidized  employment  in  all  states  except  New  York,  where  there  were 
virtually  no  effects  of  the  training  component  of  the  demonstration.   Earnings 
effects  during  post demonstration  Year  1  were  still  positive,  though  smaller, 
in  all  states  except  Texas  and  New  York,   During  postdemonstration  Year  2, 
earnings  effects  were  still  positive  and  statistically  significant  in  all 
states  except  New  York  and  South  Carolina,  and  in  Kentucky  and  Texas  they  were 
higher  than  in  the  first  postdemonstration  year. 

The  effects  on  AFDC  and  food  stamp  benefit  receipt  were  consistent 
with  the  beneficial  effects  on  earnings.   In  all  states  except  New  York  there 
were  substantial  reductions  in  the  percent  receiving  AFDC  benefits,  and  in  the 
amounts  received.   There  were  significant,  though  smaller,  reductions  in  food 
stamp  benefit  receipt  and  amount  in  four  of  the  seven  states. 

There  were  small  beneficial  effects  on  one  or  more  aspects  of 
trainee  psychological  well-being  in  all  states  except  Arkansas  and  Kentucky. 
The  largest  and  most  consistent  psychological  effect  was  on  trainees'  overall 
satisfaction  with  their  lives. 
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IV.   BENEFITS  AND  COSTS 


The  benefits  and  costs  of  the  client  and  trainee  components 
separately,  and  of  the  two  components  taken  together,  are  summarized  in  this 
chapter. 

Analytic  Approach  to  Benefit-Cost  Analysis 

The  fundamental  question  addressed  is:   Does  the  total  value  of  the 
beneficial  effects  of  the  demonstration,  relative  to  what  would  have  occurred 
in  its  absence,  exceed  the  value  of  the  additional  resources  (net  of 
evaluation  costs)  required  to  run  the  program?   From  a  policy  perspective, 
therefore,  we  are  not  examining  whether  in-home  care  per  se  has  positive 
benefits  compared  with  no  in-home  care.   We  are  measuring  the  net  benefits  of 
devoting  additional  resources  to  in-home  care,  over  and  above  the  in-home  care 
already  being  provided. 

As  in  most  public  programs,  the  benefits  and  costs  of  the  demon- 
strations are  likely  to  accrue  to  different  people.   Therefore,  we  assess 
benefits  and  costs  from  three  perspectives:  that  of  society  as  a  whole;  that 
of  participants  and  their  families;  and  that  of  taxpayers.   Net  benefits  are 
benefits  minus  costs.   Net  benefits  to  society  are  the  sum  of  net  benefits  (or 
net  costs)  to  participants  and  net  benefits  (or  net  costs)  to  taxpayers. 
Programs  are  generally  viewed  as  worthwhile  if  they  yield  positive  net 
benefits  from  society's  perspective,  as  long  as  the  distribution  of  their 
benefits  and  costs  between  participants  and  taxpayers  is  acceptable. 

Measurement  of  benefits  and  costs  is  further  complicated  for  the 
AFDC  Homemaker-Home  Health  Aide  Demonstrations  because  they  tested  two  program 
interventions  simultaneously.   For  policy  purposes,  it  is  useful  to  know  the 
net  benefits  of  each  of  the  two  components  separately,  as  well  as  in  combina- 
tion, since  either  component  could  be  implemented  as  a  separate  program. 
Accordingly,  we  present  three  sets  of  net  benefit  estimates — one  for  each 
component  taken  separately  and  one  for  the  two  components  combined.   Note  that 
the  net  benefits  of  the  demonstrations  as  a  whole  are  not  the  simple  sum  of 
the  net  benefits  of  their  client  and  trainee  components.   This  is  because  the 
value  of  services  to  clients  and  the  costs  of  service  provision  necessarily 
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appear  in  the  separate  accounting  of  each  component,  since  these  benefits  and 
costs  would  be  incurred  if  either  component  were  implemented  by  itself.   In 
the  combined  accounting  they  are  appropriately  counted  only  once. 

Estimates  of  program  benefits  and  costs  can  only  be  a  reliable  guide 
to  policy  to  the  extent  that  all  major  items  are  included  in  the  benefit-cost 
accounting.   For  items  that  have  an  unambiguous  dollar  value  (such  as  trainee 
earnings),  this  is  straightforward.   However,  there  are  two  types  of  items 
that  are  not  directly  measured  in  monetary  terms  but  which  it  is  important, 
nonetheless,  to  include:  items  to  which  a  dollar  value  can  be  imputed  (such  as 
the  value  of  trainee  services  to  clients)  and  items  which  are  not  susceptible 
to  monetary  measurement  (such  as  effects  on  client  health  status  and 
psychological  well-being).   Our  approach  is  first  to  estimate  net  monetary 
benefits  (directly  measured  plus  imputed  items).   If  overall  net  monetary 
benefits  are  negative — that  is,  if  the  monetary  costs  exceed  the  monetary 
benefits — we  then  discuss  how  valuable  any  nonmonetary  benefits  would  have  to 
be  to  make  the  program  cost-effective.   If  net  monetary  benefits  are  positive, 
there  is  no  need  to  value  nonmonetary  benefits. 

Client  Component 

For  the  client  component  of  the  demonstrations,  the  major  expected 
benefits  from  the  social  perspective  were  reduced  institutionalization,  with 
conmensurate  reductions  in  Medicare  and  Medicaid  reimbursements  for  hospitals, 
nursing  homes,  and  other  medical  services.  The  major  expected  costs  were  the 
operational  costs  of  the  demonstrations.   In  addition,  the  demonstrations 
could  be  expected  to  lead  to  reduced  costs  in  nondemonstration  home  care 
programs  and  reduced  burdens  on  informal  caregivers,  through  displacement  of 
nondemonstration  formal  and  informal  care  by  demonstration  services. 
Nonmonetary  benefits  were  expected  in  the  form  of  improved  client  functioning, 
health  status,  and  well-being  (in  comparison  to  controls). 

Table  IV. 1  shows  the  net  benefits  of  the  client  component  from  the 
three  perspectives  of  interest.   As  can  be  seen  from  the  first  column  of  the 
table,  none  of  the  demonstration  projects  produced  positive  net  monetary 
benefits  from  the  social  perspective.   The  net  social  costs  of  the  client 
component  in  monetary  terms  ranged  from  a  low  of  $2.87  per  hour  of 
demonstration  service  to  a  high  of  $24.53.   Against  these  costs  must  be 
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TABLE  IV. 1.   Net  Benefics  of  CLienc  Component 
(dollars  per  hour  of  service) 


Clients  and 
Soc  iety Informal  Caregivers Taxpayers 


Arkansas  -24.53  .56  -25.09 

Kentucky  -18.80  1.36  -20.16 

New  Jersey  -9.76  .80  -10.56 

New  York  -20.10  .26  -20.36 

Ohio  -2.87  .98  -3.85 

South  Carolina  -4.28  .73  -5.01 

Texas  -13.93  .36  -14.29 

SOURCE:   Orr,  Benefits  and  Costs  (1987),  Table  S.l. 


Benefits  not  valued  in  monetary  terms: 

•   Improved  client  health,  physical  functioning,  and 
psychological  well-being 
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weighed  the  positive  effects  on  client  health,  physical  functioning,  and 
psychological  well-being  discussed  in  Chapter  II. 

The  primary  reason  net  social  benefits  were  not  positive  was  failure 
to  achieve  the  expected  reduction  in  use  of  hospitals  and  nursing  homes.   In 
this  respect,  the  client  component  of  the  AFDC  Homemaker-Home  Health  Aide 
Demonstrations  is  similar  to  other  demonstrations  of  community-based  care  that 
have  been  undertaken  in  the  last  decade.   Nine  such  demonstrations  have  been 
evaluated  with  rigorous  random  assignment  methods,  only  one  of  which  achieved 
positive  net  benefits.   This  was  the  Wisconsin  Community  Care  Options  (CCO) 
program.   CCO  served  mentally  ill  and  nonelderly  clients  as  well  as  the  frail 
elderly,  and  achieved  its  positive  result  through  a  reduction  in 
hospitalization,  not  nursing  home  use.   The  only  random  assignment  evaluation 
to  achieve  a  reduction  in  nursing  home  use  was  the  South  Carolina  Long  Term 
Care  Project.   Its  selection  process  included  a  mandatory  preadmission  screen, 
and  even  its  reduction  in  institutionalization  did  not  enable  it  to  do  more 

than  break  even.   The  other  seven  demonstrations  had  widely  ranging  net  social 

2 
costs  for  direct  services.    The  lowest  was  achieved  by  Worcester  Home  Care, 

$54  per  client  per  month.   The  highest  was  San  Diego  Long  Term  Care,  at 

$346  per  client  per  month.   The  AFDC  Homemaker-Home  Health  Aide  Demonstration 

estimates — converted  from  cost  per  hour  of  service  to  cost  per  client  per 

month — span  the  range  of  previous  evaluations: 

Arkansas  $576 

Kentucky  214 

New  Jersey  266 

New  York  474 

Ohio  53 

South  Carolina  24 

Texas  434 


These  are  the  National  Long  Term  Care  Demonstration  (Channeling), 
Worcester  Home  Care,  NCHSR,  Georgia  AHC,  Wisconsin  CCO,  Project  OPEN,  South 
Carolina  LTC,  Florida  Pentastar,  and  San  Diego  LTC.  For  a  detailed  comparison 
of  the  evaluation  results  of  these  demonstrations,  see  Robert  Applebaum  et 
al.  The  Evaluation  of  the  National  Long  Term  Care  Demonstration;  Tables 
Comparing  Channeling  to  Other  Community  Care  Demonstrations.  Princeton,  NJ: 
Mathematica  Policy  Research  (1986). 

2  ,         .       / 

We  exclude  case  management  costs  from  this  comparison,  since  the 

AFDC  Homemaker-Home  Health  Aide  Demonstrations  did  not  provide  ongoing  compre- 
hensive case  management. 
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Only  in  South  Carolina  was  Che  net  social  cost  of  the  demonstration  less  than 
the  lowest  of  the  comparable  previous  demonstrations.   In  Texas,  New  York,  and 
Arkansas,  net  social  costs  were  greater  than  the  highest  of  the  previous 
demonstrations . 

Table  IV. 2  shows  the  major  benefit  and  cost  components  for  each 
state.   Only  in  New  Jersey  and  Ohio  were  there  appreciable  reductions  in 
Medicare/Medicaid  reimbursements  for  hospitals,  nursing  homes,  and  other 
medical  services.   In  the  other  states  there  was  essentially  zero  effect.   In 
fact,  the  largest  single  social  benefit  in  all  states  except  New  Jersey  was 
simply  reduction  in  the  cost  of  nondemonstration  services  due  to 
displacement.   On  the  other  side  of  the  ledger,  operational  costs  were 
typically  high — substantially  higher  than  the  Medicare  cost  limits.   If  the 
operational  costs  of  the  client  component  had  been  kept  to  the  Medicare  cost 
limits,  all  the  demonstrations  would  still  have  incurred  net  costs,  but  they 
would  have  been  smaller  (ranging  from  41  cents  per  hour  of  service  in  Ohio  to 
$9.51  in  Arkansas). 

It  should  be  noted  that  in  return  for  these  net  costs,  society 
reaped  several  nonmonetary  benefits.   For  all  the  demonstrations  taken 
together  there  were  beneficial  effects  on  physical  and  mental  functioning,  and 
self-reported  health  status.   Demonstration  clients  also  reported  fewer 
medical  conditions  that  were,  in  their  own  judgment,  worse  at  reassessment 
(i.e.,  after  receipt  of  demonstration  services). 

Who  paid  the  cost  of  the  client  component?   As  can  be  seen  from 
looking  back  at  the  third  colvimn  of  Table  IV.  1,  the  taxpayers.   Taxpayers  bore 
net  costs  in  all  seven  demonstration  states,  ranging  from  a  low  of  $3.85  per 
hour  of  service  in  Ohio  to  a  high  of  $25.09  per  hour  of  service  in  Arkansas. 
Clients  benefited  in  monetary  terms  in  every  demonstration  project,  but  not  by 
very  much — 26  cents  to  $1.36  per  hour  of  service.   The  major  components  of 
this  benefit  were  reduced  client  fees  for  nondemonstration  services  and  the 
value  of  informal  caregivers'  time  freed  up  by  the  aides*  presence. 

Trainee  Component 

For  the  trainee  component  of  the  demonstrations  the  major. expected 
benefits  from  the  social  perspective  were  increased  nondemonstration  earnings 
of  trainees  and  the  value  of  the  services  the  trainees  provided  for  clients. 
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The  major  expected  costs  were  the  operational  costs  of  the  demonstrations, 
work-related  expenses  of  trainees  (mainly  child  care),  and  the  leisure  and 
home  production  foregone  by  the  i"rainees  in  order  to  participate  in  the 
demonstration  and  work  in  unsubsidized  jobs. 

Table  IV. 3  shows  the  net  benefits  of  the  trainee  component  of  the 
seven  demonstration  projects  from  the  three  perspectives  of  interest.   As  can 
be  seen  from  the  first  column  of  the  table,  social  benefits  exceeded  social 
costs  for  the  trainee  component  in  all  states  except  New  York — net  social 
benefits  ranged  from  $2,226  per  training  entrant  (i.e.,  per  program  slot)  to 
$12,961. 

These  estimates  compare  relatively  favorably  with  the  net  social 
benefits  estimated  by  random  assignment  evaluations  of  similar  employment  and 
training  programs  for  AFDC  recipients.   So  far  there  have  been  four  such 
evaluations.   All  achieved  positive  net  social  benefits,  ranging  from 
$348  per  trainee  to  $8,150.   The  high  end  of  the  range  was  for  Supported  Work, 
which  was  the  most  similar  to  the  AFDC  Homemaker-Home  Health  Aide  Demon- 
strations in  providing  a  subsidized  work  opportunity  which  lasted  on  average 
for  most  of  a  year.   Net  social  benefits  in  three  of  the  demonstration  states 
exceeded  even  the  Supported  Work  estimate:  South  Carolina  ($9,483),  Ohio 
($12,208),  and  New  Jersey  ($12,961). 

The  major  benefits  and  costs  of  the  trainee  component  are  shown  in 
Table  IV. 4.   In  all  the  demonstration  states  except  South  Carolina  the  largest 
social  benefit  was  the  increase  in  nondemonstration  earnings  of  trainees, 
which  ranged  from  $2,181  per  training  entrant  in  New  York  to  $18,962  in  New 
Jersey.   (These  estimates  include  the  present  discounted  value  of  projected 
earnings  gains  over  the  trainee's  working  life.)   The  value  of  services  to 


They  are:  Supported  Work  (see  Peter  Kemper  et  al .  The  Supported 
Work  Demonstration:  Final  Benefit-Cost  Analysis.  New  York:  Manpower 
Demonstration  Research  Corporation,  1981);  the  Baltimore,  Maryland,  Employment 
Initiatives  (see  Dan  Friedlander,  et  al.  Final  Report.  New  York:  Manpower 
Demonstration  Research  Corporation,  December  1985);  the  San  Diego  Job  Search 
and  Work  Experience  Demonstration  (see  Barbara  Goldman  et  al.  Final  Report. 
New  York:  Manpower  Demonstration  Research  Corporation,  February  1986);  and  the 
Arkansas  Work  Program  (see  Dan  Friedlander  et  al.  Final  Report.  New  York: 
Manpower  Demonstration  Research  Corporation,  September  1985). 
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TABLE  IV. 3   Net  Benefits  of  Trainee  Component 
(doLLars  per  training  entrant) 


Society Trainees Taxpayers 


Arkansas  2,226  -3,803  6,029 

Kentucky  3,858  7,820  -3,962 

New  Jersey  12,961  17,653  -4,692 

New  York  -3,594  4,780  -8,374 

Ohio  12,208  10,335  1,873 

South  Carolina  9,483  1,986  7,497 

Texas  5,604  9,342  -3,738 

SOURCE:   Orr,  Benefits  and  Costs  (1987),  Table  S.2. 
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clients  was  Che  major  benefit  in  South  Carolina;  at  $12,643,  it  was  the 
highest  of  any  of  the  states.   The  Largest  costs  in  nearly  all  demonstration 
states  were  the  operational  costs  (ranging  from  $4,299  per  training  entrant  in 
Ohio  to  $8,688  in  Kentucky). 

Who  reaped  the  benefits  of  the  trainee  component?   The  answer  can  be 
seen  by  looking  back  at  the  second  and  third  columns  of  Table  IV. 3.   In  all 
but  one  of  the  states,  the  trainees  received  substantial  net  benefits  (largely 
in  the  form  of  increased  nondemonstration  earnings),  ranging  from  $1,986  to 
$17,653  per  training  entrant.   In  four  of  the  seven  states,  these  were 
received  at  a  net  cost  to  taxpayers — ranging  from  $3,738  to  $8,374  per 
training  entrant.   In  three  states  (Arkansas,  Ohio,  and  South  Carolina), 
taxpayers  received  net  benefits  from  the  trainee  component  of  the  demon- 
stration.  Only  in  Arkansas  did  taxpayer  savings  in  benefits  paid  under  AFDC, 
food  stamps,  Medicaid,  and  other  public  programs  exceed  the  cost  of  aides' 
demonstration  wages — as  a  result,  trainees  in  that  state  suffered  net  costs 
from  participating  in  the  demonstration. 

Client  and  Trainee  Components  Combined 

Table  IV. 5  summarizes  the  net  benefits  of  the  demonstration  as  a 
whole.   The  trainee  estimates  have  been  incorporated  into  these  overall 
estimates  as  dollars  per  hour  of  demonstration  service  for  comparability.   As 
can  be  seen  in  the  first  column  of  the  table,  only  in  New  Jersey  and  Ohio  were 
the  net  social  benefits  for  the  two  components  taken  together 
positive — $15.75  and  $13.47  per  hour  of  demonstration  services, 
respectively.   These  were  states  that  combined  relatively  low  operational 
costs  with  large  increases  in  trainee  nondemonstration  earnings.   South 
Carolina  essentially  broke  even.   Operational  costs  in  that  state  were  the 
lowest  of  any  of  the  states,  but  the  demonstration-induced  increases  in 
trainee  nondemonstration  earnings  were  also  lower  than  in  other  states. 
Arkansas,  Kentucky,  and  Texas  had  negative  net  social  benefits  (i.e.,  social 
costs)  of  $9.67,  $4.47,  and  $3.68  per  hour  of  demonstration  service, 
respectively,  reflecting  relatively  high  operational  costs.   New  York's  net 
social  costs  were  substantially  the  highest  of  all  the  states.   This  was  a 
combination  of  training  costs  that  were  nearly  five  times  as  high  pet  hour  of 
service  delivered  as  those  of  the  next  highest  state,  service  provision  costs 


58 


TABLE  IV. 5   Net  Benefits  of  Client  and  Trainee  Components  Combined 
(dollars  per  hour  of  demonstration  service) 


Society 

Ta 

xpayers 

Trainees 

Clients 

Arkansas 

-9.67 

2.33 

-12.56 

.56 

Kentucky 

-4.47 

-22.42 

16.59 

1.36 

New  Jersey 

15.75 

-17.58 

32.53 

.80 

New  York 

-40.00 

-81.86 

41.60 

.26 

Ohio 

13.47 

-1.11 

13.60 

.98 

South  Carolina 

L 

-.39 

-2.79 

1.67 

.73 

Texas 

-3.68 

-22.89 

18.85 

.36 

SOURCE:   Orr, 

Benefits 

and  Costs 

(1987), 

Table  S.3. 

Benefits  not  valued  in  monetary  terms: 

•   Improved  client  health,  physical  functioning,  and 
psychological  well-being 
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that  were  also  the  highest  of  any  state,  and  relatively  modest  increases  in 
trainee  nondemonstration  earnings. 

Who  paid  the  costs  and  who  reaped  the  benefits  of  the  seven 
AFDC  Homemaker-Home  Health  Aide  Demonstration  projects?   The  demonstrations 
cost  taxpayers  money  in  all  states  except  Arkansas.   These  costs  were  modest 
in  Ohio  and  South  Carolina — less  than  $3.00  per  hour  of  demonstration 
service.   They  ranged  from  $17.58  to  $22.89  per  hour  of  service  in  Kentucky, 
New  Jersey,  and  Texas.   They  were  much  the  highest  in  New  York — almost 
$82.00  per  hour  of  service.   Trainees  benefited  substantially  from  the 
demonstration  in  all  states  except,  again,  Arkansas.   Client  monetary  benefits 
in  all  states  were  positive,  though  relatively  small.   These  were  attributable 
to  reduced  expenditures  on  nondemonstration  in-home  care  and  the  value  of 
reductions  in  informal  care.   To  these,  of  course,  must  be  added  the  benefits 
in  improved  client  health,  physical  functioning,  and  psychological  well- 
being. 

As  noted,  the  two  demonstration  projects  which  achieved  positive 
overall  net  social  benefits  were  New  Jersey  and  Ohio.   In  New  Jersey,  the 
trainee  net  benefits  were  double  the  net  social  benefits,  the  difference  being 
paid  for  by  taxpayers.   In  Ohio,  in  contrast,  the  net  social  benefits  went 
almost  entirely  to  the  trainees,  but  not  at  taxpayer  expense.   In  Arkansas, 
unlike  all  the  other  demonstrations,  the  net  social  cost  was  borne  entirely  by 
trainees.   In  the  other  four  demonstrations,  the  costs  to  the  taxpayers  were 
higher  than  the  benefits  to  society — representing  net  transfers  from  taxpayers 
to  trainees. 
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V.   SUMMARY  AND  INTERPRETATION 


The  AFDC  Homemaker-Home  Health  Aide  Demonstrations  were  implemented 
simultaneously  in  seven  states,  subject  to  broad  statutory  and  regulatory 
guidelines.   The  state  demonstration  projects  were  similar  in  their  major 
features,  although  they  differed  in  detail  in  numerous  ways.   More 
importantly,  the  environment  of  the  demonstration  varied  markedly  from  state 
to  state.   The  estimated  effects  of  the  seven  individual  state  projects 
therefore  provide  some  evidence  of  the  range  of  outcomes  that  could  be 
expected  if  the  demonstration  were  implemented  as  a  regular  program. 

The  demonstration  states  were  not  chosen  to  be  representative  of  the 
nation  as  a  whole;  nor  can  the  outcomes  in  these  states  be  generalized 
directly  to  other  participant  populations,  program  operating  characteristics, 
or  environments.   Nevertheless,  to  the  extent  that  the  estimated  effects  of 
the  demonstration  were  relatively  consistent  across  these  seven  states,  we  can 
have  some  confidence  that"  similar  effects  would  be  observed  if  a  program 
operating  under  the  same  guidelines  were  adopted  in  another  locale.   To  the 
extent  the  outcomes  differ  across  the  seven  state  projects,  they  provide  a 
measure  of  the  range  of  uncertainty  about  the  results  that  could  be  expected. 

In  this  chapter,  we  examine  the  overall  patterns  of  the  demon- 
stration effects  across  the  seven  states,  to  see  what  overall  conclusions  and 
implications  can  be  drawn.  We  first  consider  the  estimated  effects  on 
clients,  then  the  effects  on  trainees.  We  close  with  a  discussion  of  the 
benefit-cost  analyses  of  the  client  and  trainee  components,  taken  separately 
and  together. 

Effects  on  Clients 

The  estimated  effects  of  the  client  component  were  quite  consistent 
across  the  seven  demonstration  states.   In  all  states,  the  demonstration  sig- 
nificantly increased  the  amount  of  formal  in-home  services  received  by 
clients,  and  in  six  of  the  seven  the  combined  amount  of  formal  services  and 
informal  care  from  nonhousehold  sources  was  increased.   In  most  states,  there 
was  little  substitution  of  formal  for  informal  care.   Thus,  it  seems  clear 


that  the  demonstration  treatment  was  implemented  as  intended,  although  the 
average  increase  in  formal  services  —  1  1/2  to  10  hours  per  week  —  was  not  a 
particularly  intensive  treatment  in  most  states. 

The  major  expected  effect  of  the  client  component  was  a  reduction  in 
time  spent  in  hospitals  and  nursing  homes.   Here  the  evaluation  results  are 
also  quite  consistent:   None  of  the  demonstration  projects  achieved  a  sig- 
nificant reduction  in  hospital  or  nursing  home  utilization  over  the  one-year 
followup  period  as  a  whole,  although  one  (New  Jersey)  produced  a  slight 
reduction  in  time  spent  in  hospitals  during  the  first  six  months  after  entry 
into  the  demonstration.   The  results  are  the  same  whether  utilization  is 
measured  by  proportion  of  clients  admitted,  fraction  of  the  followup  period 
institutionalized,  or  (for  hospitals)  average  length  of  stay. 

Consistent  with  the  general  lack  of  effects  on  institutionalization, 
there  were  virtually  no  significant  effects  on  Medicare  and  Medicaid  reim- 
bursements for  hospital  and  nursing  home  care.   The  only  consistent  effects  on 
Medicare  and  Medicaid  costs  were  savings  in  home  health  care  reimbursements 
attributable  to  displacement  of  nondemonstration  services. 

The  demonstration  was  not  expected  to  prevent  hospitalization, 
although  it  was  anticipated  that  the  availability  of  home  care  might  shorten 
hospital  stays  by  allowing  clients  to  recuperate  at  home.   It  was  expected  to 
prevent  or  delay  nursing  home  admissions,  however.   In  fact,  the  scope  for 
achieving  large  reductions  in  nursing  home  utilization  among  this  population 
turned  out  to  be  quite  limited,  simply  because  few  of  the  demonstration 
clients  would  have  entered  a  nursing  home  in  the  absence  of  the 
demonstration.   In  no  state  did  more  than  16  percent  of  the  client  controls 
enter  a  nursing  home;  and  in  all  states  client  controls  spent  on  average 
5  percent  or  less  of  the  one-year  followup  period  in  nursing  homes. 

The  failure  of  the  demonstration  to  effectively  target  services  on 
clients  who  would  otherwise  have  been  admitted  to  nursing  homes  is  probably 
due  to  at  least  two  factors.   First,  it  is  now  generally  recognized  as 
extremely  difficult  to  predict  institutionalization  on  the  basis  of  observable 
client  characteristics.   Even  among  the  six  high-risk  subgroups  analyzed  in 
this  evaluation,  two-thirds  or  more  of  the  client  controls  were  not  admitted 
to  nursing  homes  during  the  followup  period.   Nursing  home  admissions  are  the 
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result  of  an  interaction  of  social,  economic,  and  institutional  factors  that 
may  be  too  complex  to  allow  systematic  prediction. 

Most  other  recent  evaluations  of  community-based  care  demonstrations 
have  had  no  greater  targeting  success  than  the  AFDC  Homemaker-Home  Health  Aide 
Demonstrations.   The  very  few  that  have  identified  a  high-risk  group  (as 
measured  by  institutionalization  rates  of  the  nonservice  group)  have  either 
not  used  a  random  assignment  methodology  or  have  implemented  an  intervention 
with  unusual  characteristics.   Other  HCFA-sponsored  studies  currently  underway 
are  focusing  specifically  on  the  targeting  issue  in  an  effort  to  increase  our 
insight  into  the  factors  that  can  predict  high  risk.   If  such  factors  can  be 
identified — and  if  they  are  susceptible  to  measurement  at  program  entry — the 
potential  of  community-based  care  alternatives  to  reduce  long-term  care  costs 
may  be  substantially  enhanced. 

A  second  reason  for  the  failure  of  the  demonstration  to  target 
services  on  clients  at  imminent  risk  of  institutionalization  may  be  that  the 
local  intake  staff  who  actually  selected  the  demonstration  clients  may  not 
have  shared  this  objective.  The  stated  objective  of  the  demonstration  at  the 
federal  and  state  level  notwithstanding,  local  staff  may  well  have  viewed  the 
demonstration  services  as  a  way  to  improve  the  quality  of  life  of  the  clients, 
rather  than  as  a  means  of  preventing  institutionalization.   In  fact,  in  most 
states  only  a  minor  fraction  of  client  applicants  were  deemed  ineligible  on 
the  basis  of  the  inperson  assessments. 

Even  if  better  targeting  were  possible,  it  is  not  clear  that  the 
major  objective  of  the  demonstration  could  be  achieved.   Examination  of 
demonstration  effects  on  the  six  high-risk  client  subgroups  analyzed  in  this 
evaluation  revealed  a  virtually  uniform  lack  of  significant  effects  even 
within  these  more  limited  populations.   It  is,  of  course,  possible  that  more 
intensive  services  than  those  provided  in  the  demonstration,  or  a  different 
allocation  of  services  among  clients,  would  be  more  effective  in  preventing 
institutionalization.   This  evaluation  cannot  address  the  latter  possibility; 
it  can  only  measure  the  effects  of  the  allocation  of  services  actually 
implemented  in  the  demonstration.  With  regard  to  intensity  of  service,  it 
should  be  noted  that  there  was  no  systematic  demonstration  effect  in  any  of 
the  seven  demonstration  states,  even  though  intensity  of  service  varied  more 
than  fivefold  across  the  states. 
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The  findings  with  regard  to  client  health  and  functioning  are  more 
positive.   Across  the  six  states  in  which  client  reassessments  were  conducted, 
the  demonstration  had  significant  beneficial  effects  on  a  number  of  measures, 
and  no  adverse  effects.   Relative  to  client  controls,  demonstration  service 
clients  were  less  dependent  in  both  Activities  of  Daily  Living  and  Instru- 
mental Activities  of  Daily  Living;  were  better  oriented  mentally;  and  rated 
their  own  health  better  at  reassessment.   Moreover,  the  speech  and  communica- 
tion abilities  of  service  clients  deteriorated  less  than  those  of  their 
control  counterparts  over  the  period  from  initial  assessment  to  reassessment 
(on  average,  about  20  months),  and  fewer  service  clients  reported  that  their 
specific  medical  conditions  had  gotten  worse  in  the  12  months  prior  to 
reassessment.   There  were  no  significant  effects  on  the  more  purely  physio- 
logical measures  of  vision,  hearing,  and  judgment;  incidence  of  specific 
medical  conditions;  or  restriction  of  activities. 

All  the  beneficial  effects  on  client  health  and  functioning  were 
relatively  modest.   They  were,  however,  more  pervasive  and  ciDnsistent  than 
those  found  in  earlier  community  care  demonstrations.   These  findings  suggest 
that,  even  though  the  demonstration  did  little  to  prevent  institution- 
alization, it  did  improve  the  quality  of  life  for  the  elderly  and  functionally 
impaired  residing  in  the  community. 

Effects  on  Trainees 

Demonstration  effects  on  trainees  were  much  more  positive,  although 
somewhat  more  variable  across  states,  than  those  on  clients.   Six  of  the  seven 
states  succeeded  in  achieving  the  major  objective  of  the  trainee  compo- 
nent— increasing  the  earnings  of  trainees  in  unsubsidized  employment — in  at 
least  one  of  the  first  two  years  after  the  typical  trainee  left  the 
demonstration.  Moreover,  these  effects  were  relatively  large — on  the  order  of 
$100-$200  per  month  in  five  states.  These  unsubsidized  earnings  gains  reflect 
significant  increases  in  employment  rates  and  hours  of  work,  relative  to  the 
control  group,  as  well  as  significantly  higher  hourly  wage  rates  in  five 
states.   The  latter  finding  is  particularly  important,  because  wage  rate  gains 
are  evidence  of  increased  productivity. 

It  is  also  noteworthy  that  gains  in  unsubsidized  employment  and 
earnings  were  consistently  larger  and  more  prevalent  in  the  second  than  in  the 
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first  postdemonstration  year.   In  part,  this  reflects  the  fact  that  some 
trainees  were  stilL  in  subsidized  employment,  rather  than  unsubsidized  jobs, 
during  the  first  year  after  the  typical  trainee  left  the  demonstration.   But 
it  is  evidence  that  the  employment  gains  following  demonstration  participation 
were  not  short-lived  and,  in  fact,  were  likely  to  extend  beyond  the  evaluation 
followup  period. 

Effects  on  trainee  welfare  dependence  were  consistent  with  those  on 
employment  and  earnings.   All  seven  demonstration  projects  significantly 
reduced  the  proportion  of  trainees  receiving  AFDC  in  a  typical  month  during 
the  followup  period,  relative  to  the  receipt  rate  of  controls,  and  five 
significantly  reduced  dependence  on  food  stamps. 

In  the  first  year  after  the  typical  trainee  had  left  the  demon- 
stration, average  combined  AFDC  and  food  stamp  benefits  were  significantly 
reduced  in  six  of  the  seven  states,  by  amounts  ranging  from  $53  to  $118  per 
month.   In  four  states,  benefit  reductions  of  $38  to  $95  per  month  persisted 
into  the  second  postdemonstration  year. 

The  effects  on  welfare  dependence,  while  substantial  and  consistent 
across  states,  were  thus  shorter  lived  than  those  on  nondemonstration 
earnings.   This  is  to  be  expected.   In  all  states,  controls  were  gradually 
leaving  the  welfare  rolls  over  the  course  of  the  followup  period,  reflecting 
normal  caseload  turnover.  Trainees  could  maintain  their  earnings  advantage 
long  after  both  they  and  their  control  counterparts  had  left  welfare;  as 
controls  left  the  welfare  rolls,  however,  the  potential  for  welfare  benefit 
savings  was  progressively  reduced. 

There  were  no  significant  reductions  in  average  Medicaid  benefits 
over  the  followup  period  as  a  whole,  even  though  Medicaid  eligibility  is 
closely  tied  to  AFDC  status,  and  AFDC  benefit  receipt  was  substantially 
reduced  in  all  states.   This  is  largely  because  the  Medicaid  eligibility  of 
demonstration  trainees  was  automatically  extended  for  a  period  of  up  to 
12  months.   In  four  of  the  six  states  in  which  Medicaid  data  were  collected, 
Medicaid  benefits  were  in  fact  reduced  in  the  period  after  most  trainees  had 


In  the  benefit-cost  analysis,  we  projected  that  trainee  earnings 
gains  would  decline  by  3  percent  per  year  after  the  end  of  the  evaluation 
followup  period. 
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left  the  demonstration;  but  these  reductions  were  not  sufficient  to  offset  the 
increases  in  Medicaid  cost  while  the  trainees  were  participating  in  the 
demonstration.   Given  the  large  effects  on  AFDC  receipt,  it  seems  likely  that 
overall  Medicaid  savings  would  have  been  much  greater  if  trainees'  eligibility 
had  not  been  extended.   It  should  be  recognized,  however,  that  the  effects  on 
employment  and  welfare  benefits  might  have  been  smaller  without  the  Medicaid 
eligibility  extension,  which  weakens  the  disincentive  to  leave  welfare  posed 
by  the  loss  of  Medicaid  coverage. 

Taken  together,  the  evaluation  results  for  the  trainee  component  are 
quite  positive.   They  compare  favorably  with  the  findings  of  even  the  most 
successful  prior  evaluations  of  employment  and  training  interventions  for  the 
AFDC  population.   It  seems  clear  that  training  as  homemaker-home  health  aides 
is  an  effective  way  to  move  AFDC  recipients  off  the  welfare  rolls  and  into 
unsubsidized  employment.  Moreover,  the  gains  in  earnings  and  self-sufficiency 
resulting  from  such  training  appear  to  be  relatively  long-lived  and  reflect 
improvements  in  productivity,  as  well  as  simply  increased  hours  of  work.   Nor 
were  the  employment  gains  of  the  trainees  restricted  to  work  as  homemaker-home 
health  aides — a  relatively  low-paid  occupation  in  the  private  sector.  A  large 
fraction  of  trainees  found  unsubsidized  employment  in  non-health-related 
jobs.  Apparently,  the  demonstration  had  a  more  general  pffect  of  increasing 
the  trainees'  ability  to  obtain  more  and  better  employment  in  jobs  other  than 
those  for  which  they  were  specifically  trained.   In  interpreting  these 
results,  it  must  be  borne  in  mind  that  all  of  the  demonstration  trainees  were 
volunteers,  and  therefore  presumably  more  highly  motivated  than  the  average 
AFDC  recipient. 

A  final  important  question  addressed  by  the  evaluation  of  the 
trainee  component  is  whether  a  different  method  of  selecting  among  demon- 
stration applicants  could  have  yielded  even  more  positive  results.  At  intake, 
demonstration  staff  selected  among  applicants  on  the  basis  of  a  large  number 
of  personal  characteristics.   Some  of  these  were  measured  by  the  evaluation; 
intake  workers'  assessment  of  both  measured  and  unmeasured  trainee  charac- 
teristics are  summarized  by  their  ratings  of  applicants'  potential  as 
homemaker-home  health  aides.   Intake  workers  appear  to  have  been  successful  in 
identifying  those  applicants  who  would  do  best,  in  terms  of  future  earnings 
and  welfare  dependence,  with  or  without  training.   They  were  not  able  to 
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identify  those  applicants  who  would  benefit  the  most  from  training  and 
subsidized  employment.   In  fact,  with  the  exception  of  prior  education  (which 
had  a  consistently  positive  influence),  neither  objective  measured  character- 
istics nor  the  more  subjective  attributes  captured  by  the  potential  ratings 
provide  much  useful  information  for  predicting  the  effects  of  the  demonstra- 
tion on  specific  trainees.   Thus,  even  with  the  benefit  of  hindsight,  it 
appears  that  there  is  little  scope  for  enhancing  program  effects  by  targeting 
services  on  specific  types  of  trainees. 

Benefits  and  Costs 

The  overall  benefits  and  costs  of  the  demonstrations  show  that 
in  only  two  of  the  states  were  the  demonstrations,  as  implemented,  cost- 
effective.   Even  in  those  states,  the  client  component  did  not  break  even;  the 
overall  positive  results  were  because  the  positive  net  benefits  from  the 
trainee  side  of  the  demonstrations  more  than  compensated  for  the  net  costs  of 
the  client  side. 

The  client  component  taken  by  itself  was  not  cost-effective  in  any 
state.   In  large  part,  this  was  because  the  major  expected  benefits  of  the 
client  component — reductions  in  costs  of  institutionalization — did  not 
materialize  in  most  states.  Only  in  Ohio  and  New  Jersey  were  there  any 
appreciable  reductions  in  Medicare  and  Medicaid  reimbursements  for  services 
other  than  home  care — and  in  those  states,  the  savings  were  primarily  in 
hospital,  not  nursing  home,  reimbursements.   In  the  remaining  states.  Medicare 
and  Medicaid  savings  offset  less  than  10  percent  of  the  operational  costs  of 
the  demonstrations.   The  largest  single  measured  social  benefit  of  the  client 
component  in  all  states  except  New  Jersey  was  simply  the  displacement  of 
nondemonstration  home  care  services. 

The  general  failure  of  the  demonstrations  to  achieve  substantial 
savings  in  the  costs  of  institutionalization  reflects,  as  noted,  a  failure  to 
select  demonstration  clients  who  were  in  fact  at  risk  of  institutionaliza- 
tion.  In  no  state  did  more  than  16  percent  of  the  control  clients  enter  a 
nursing  home  during  the  one-year  followup  period.   Thus,  there  was  little 
scope  for  achieving  major  savings  in  nursing  home  costs,  even  if  the 
demonstrations  had  been  more  successful  in  preventing  or  delaying  admissions 
among  those  who  would  have  entered  nursing  homes. 
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A  striking  finding  of  the  benefit-cost  analysis  is  that  the  costs  of 
the  client  component  (net  of  evaluation  costs)  were  higher  than  the  home  care 
costs  normally  incurred  by  the  government  in  all  states  except  South 
Carolina — and  in  most  states  substantially  so.   In  part,  this  may  have  been 
due  to  administrative  costs  associated  with  the  demonstration  setting  or  to 
the  absence  of  the  strict  cost  controls  imposed  in  regular  programs.   It  also 
seems  likely  that  the  requirement  that  demonstration  aides  serve  primarily 
demonstration  clients  reduced  the  efficiency  with  which  aides  were  utilized, 
thereby  raising  the  cost  per  hour  of  service.   Even  if  the  operational  costs 
of  service  provision  had  been  within  the  Medicare  cost  limits  for  in-home 
care,  however,  the  client  component  would  not  have  been  cost-effective  in  any 
of  the  seven  states. 

The  clear  implication  of  this  analysis,  then,  is  that  if  provision 
of  home  care  services  to  this  client  population  at  public  expense  is  to  be 
justified,  it  must  be  on  the  basis  of  improving  the  quality  of  life  for  the 
frail  elderly  and  otherwise  impaired  individuals  and  their  caretakers,  not  as 
a  way  of  reducing  nursing  home  costs. 

The  results  for  the  trainee  component,  taken  by  itself,  are  much 
more  positive.  All  seven  states  achieved  substantial  increases  in  trainees* 
nondemonstration  earnings  and  at  least  modest  reductions  in  AFDC  benefits. 
Six  of  the  seven  demonstrations  produced  positive  net  social  benefits  that 
compare  favorably  with  those  found  in  evaluations  of  the  most  successful 
earlier  demonstrations  of  employment  and  training  interventions  for  the 
AFDC  population.  Moreover,  as  noted,  if  the  trainee  component  were  imple- 
mented by  itself  without  the  requirement  that  the  aides  serve  a  specific 
limited  client  group,  the  utilization  of  aides'  time  might  have  been  more 
efficient.   This  would  have  increased  the  value  of  the  aides'  services,  and 
therefore  net  social  benefits,  in  most  states. 

While  the  trainee  component  yielded  positive  net  benefits  from  a 
social  perspective  in  six  of  the  seven  states,  net  benefits  from  the  narrower 
perspective  of  taxpayers  were  positive  in  only  three.   In  the  remaining  four 
states,  the  expected  savings  in  total  AFDC,  food  stamp,  Medicaid,  and  other 
public  benefits  either  failed  to  materialize  or  were  insufficient  to  offset 
the  excess  of  operational  costs  over  the  value  of  services  provided.   In  three 
of  these  states  (Kentucky,  New  Jersey,  and  Texas),  the  policy  question  that 
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must  be  addressed  is  whether  taxpayers  are  willing  to  bear  some  costs  in  order 
to  generate  net  benefits  to  trainees  that  are  two  to  four  times  as  large  as 
taxpayer  costs.   In  New  York,  net  benefits  to  trainees  were  only  about  half  as 
large  as  taxpayer  costs.   In  Arkansas,  where  net  social  benefits  were 
positive,  the  distributional  issue  is  somewhat  different — there,  taxpayers 
enjoyed  positive  net  benefits  while  trainees  bore  net  costs. 

When  the  two  components  are  taken  together,  as  noted,  net  social 
benefits  were  positive  only  in  New  Jersey  and  Ohio.   Had  demonstration 
services  been  provided  at  costs  within  the  Medicare  cost  limits,  net  social 
benefits  would  have  been  positive  or  essentially  zero  in  all  seven  states. 
Even  in  that  hypothetical  case,  however,  the  positive  value  of  the  combined 
components  would,  in  most  states,  reflect  the  positive  benefits  of  the  trainee 
component  compensating  for  the  social  costs  of  the  client  component. 

As  implemented,  the  demonstration  as  a  whole  resulted  in  net  savings 
to  taxpayers  only  in  Arkansas.   In  four  states,  they  cost  taxpayers  more  than 
they  benefited  participants  in  monetary  terms.  Against  these  added  taxpayer 
costs  must  be  weighed  the  intangible  benefits  of  the  demonstrations  to  clients 
and  trainees  and  any  satisfaction  derived  by  taxpayers  in  knowing  that  aged 
and  impaired  clients  were  being  care  for,  and  that  former  welfare  recipients 
were  and  are  working. 

These  distributional  effects  are  important  in  assessing  the  policy 
implications  of  the  demonstrations.   However,  the  social  value  of  the 
demonstration  program,  and  of  its  two  separate  components,  should  be  judged  on 
the  basis  of  net  social  benefits,  not  simply  on  the  basis  of  monetary  savings 
to  taxpayers.   On  that  basis,  the  major  findings  of  the  benefit-cost  analysis 
of  the  AFDC  Homemaker-Home  Health  Aide  Demonstrations  are  that: 

•  Social  costs  of  the  client  component  exceeded  social 
benefits  in  all  seven  states; 

•  Net  social  benefits  of  the  trainee  component  were 
positive  and  substantial  in  all  states  except  New 
York;  and, 

•  Taking  the  two  components  together,  the  overall  net 
social  benefits  of  the  demonstrations  were  positive 
in  two  states.  New  Jersey  and  Ohio,  but  were  less 
than  those  of  the  trainee  component  alone. 
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APPENDIX 
DEMONSTRATICM  SITES,  BY  STATE 

Arkansas   (28  counties,  grouped  into  7  sites) 

Jonesboro 

Forrest  City 

Pine  Bluff 

North  Little  Rock 

FayettevilLe 

Van  Buren 

Hot  Springs 

Kentucky  (multicounty  Area  Development  Districts) 

Barren  River 

Big  Sandy 

Bluegrass 

Cumberland  Valley 

Green  River 

Kentucky  River 

Kentuckiana  Regional  Planning  and  Development  Area  (KIPDA) 

Lake  Cumberland 

Lincoln  Trail 

Northern  Kentucky 

New  Jersey 

Camden 

Cumberland 

Essex 

Monmouth 

Union 

New  York 

Albany 

New  York  City 

Rockland 

Schenectady 

Westchester 


Ohio 


Allen  Mahoning 

Athens  Montgomery 

Butler  Morrow 

Clinton  Richland 

Franklin  Stark 

Hamilton  Summit 

Highland  Tuscarawas 


Ohio  (continued) 


Lake 

Lorain 

Lucas 

South  Carolina 

Anderson 

Beaufort 

Berkeley 

Calhoun 

Charleston 

Darlington 

Dorchester 

Washington 
Wayne 


Fairfield 

Florence 

Georgetown 

Hampton 

Horry 

Jasper 

Laurens 


Lexington 

Newberry 

Orangeburg 

Richland 

Sumter 

Will iamsburj 


Texas 


Austin 
El  Paso 
Ft.  Worth 
San  Antonio 
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